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ABSTRACT 

This report traces the earliest field trials and 
later developments of the Educational and Career Exploration System 
(ECES) t a computer-based learning environment to be used as a part of 
the educational and vocational guidance services in secondary 
schools. ECES includes a set of experiences in which the student 
considers his own educationally and vocationally relevant 
characteristics, a series of exercises dealing with the structure of 
the world of work, and extensive opportunities to learn about 
decision making by manipulating information about potential 
opportunities. The initial field trial of ECES in Montclair, New 
Jersey, in 1969 and preliminary work done with ECES in Genessee 
County, Michigan, are covered briefly. These provided guidelines for 
the more extensive field trail conducted in 1971-72 in Genesee 
County, Michigan. Using the Career Development Inventory (CDI) as a 
measure of vocational maturity, posttest findings included the 
following: (1) ECES users showed larger gains than non-users both in 
degree of planning. orientation and in choice and use of resources for 
exploration; and (2) Users did not differ fron non-users in quality 
of decision making and amount of occupational career information 
po sses se d . ( Aut hor / S ES ) 
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I. INTRODUCTION 



The development of the Educational and Career Exploration System (eCES) 
began in I966 at the Advanced Systems Development Division of the International 
Business Machines Corporation. The project was headed by Dr. Frank J. Minor, in 
consultation with Professors Donald E. Super and Roger A. Myers of Teachers 
College, Columbia University. The goal of the development was to provide a 
computer-based learning environment to be used as a part of the educational and 
vocational guidance services in secondary schools. 

It was intended that a student using such a learning environment would 
benefit in a number of ways. Specifically, the system should: 

1. broaden the student's knowledge of occupational alternatives and of 
his own multi-potentiality by an exploratory process so that he could 
understand how his tentative goals relate to his personal attributes; 

2. provide the student who is interested , in post-high school education 
With a means of exploring curriculum preferences exclusive of 
occupational goals, but with the ability of relating these preferences 
to occupational potential; and 

3. provide the student with a means of narrowing the soarch for educational 
and training institutions which satisfy his career or curriculum 
preferences, his learning abilities, and his personal preferences 
(Minor, Myers, & Super, I969). 

To accomplish these goals, BCES was designed to include a set of 
experiences in which the student was caused to consider his own educationally 
and vocationally relevant characteristics, a series of exercises which helped the 
student to learn about the structure of the world of work, and extensive oppor- 
tunities to learn about decision making by manipulating information about 
potential opportunities. 

After the first model of ECES was completed. Dr. Theodore Friel joined the 
development effort and made extensive revisions and improvements. Dr. Friel has 
influenced the structure and use of ECES from that point until the present. 
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Throughout the developmental period which preceded this report, those involved 
in the construction and refinement of ECES have benefited from collaboration with 
other psychologists and educators pursuing similar goals. Through the annual 
Symposium for Systems Under Development for Vocational Guidance (See Campbell, 
1966; Minor, 196?; Tiedeman, I968), continual consultation and criticism has 
been shared with developers throughout the country. Most particularly, ECES 
growth has profited from the experiences and the interest of developers of other 
computer-based systems including Cogswell (Loughary, Friesen, & Hurst, I966), 
Harris (1968, 1972), Impellitteri (1967) , and Tiedenian (1968). 

Rationale for ECES 

During the past 20 years those most concerned with the study of occupational 
choice, career guidance, and the evaluation of guidance procedures have abandoned 
conventional concepts of vocational choice and with them the traditional criteria 
for the- evaluation of methods. Instead, they have substituted the concept of 
career or vocational development for that of occupational choice, and the develop- 
mental criterion of vocational maturity for static criteria such as having an 
occupational choice, or having a realistic occupational choice. The history of 
these changes is too long to describe in detail in this report, but some of the 
major issues, the major studies involved, and the findings to date need to be 
identified here to mke clear the basis for the evaluation procedures selected 
for the field trial described herein. 

The trait -and -factor approach which dominated work in vocational guidance 
until 1951 recognized the emergence of vocationally relevant characteristics 
in early adolescence, and seemed to fit reasonably well the organization of 
school curricula requiring prevocational choices in the ninth grade. The 



extensive and important work along these lines was discussed in detail by 
Super (19U9, revised by Super and Crites, I962). But in 195I Super (Super, 
Crites, Hummel, Mcser, Overstreet, & Warnath, I957) returned to a line of 
inquiry which he had begun prior to World War II (Super, 19I12) . He was 
encouraged in this by the results of a sociological study in the United 
States (Davidson & Anderson, 1937), a psychological study in Austria (Buehler, 
1933), and, after the War, by another American sociological study (Miller & 
Form, 1951), and an interdisciplinary American study (Ginzberg, Ginsburg, 
Axelrad, & Herma, I95I). 

The developmental approach stressed by this last group of researchers 
resulted in a series of studies of career development (Super, 1953). The Career 
Pattern Study (Super, I95U, I955; Super, et al., 1957; Super ^ Overstreet, 
I96O; Super, Kowalski, & Gotkin, 1967) demonstrated that the conventional ob-- 
jectives and criteria of vocational guidance were invalid and irrelevant in 
the ninth grade. This is because most ninth graders can and will, when asked 
to do so, report an "occupational choice"; because changes in educational and 
occupational plans are frequent during the high school years; and because 
consistency of choice or of field of choice is not related to other traits of 
known importance in ninth graders. Furthermore, even measures of realism or 
wisdom of occupational choice are unrelated to each other or to other personal 
traits in ninth grade, to similar traits later when in the twelfth grade, or 
to career success or satisfaction at age 25. Appropriate objectives and 
criteria for ninth graders were shown, by the Career Pattern Study, to involve 
planfulness and time perspective (the tendency to look ahead and plan for 
anticipated situation, having and seeking needed information, and knowing what 
kinds of ini^ormation are likely to be needed). These have been characterized 



as indices of vocational maturity, indices which show increases as adolescents 
go through high school and enter college and the world of work. 

The criteria developed by the Career Pattern Study had been used in 
independent but replicating studies in California and in the Philippines, 
and particularly in a replication with variations in Massachusetts by Gribbons 
and Lohnes (1968, I969), and as a part of an evaluation of educational and 
vocational guidance materials developed by Katz (1958) at the Educational 
Testing Service. Althoiagh differing in some important details of rr^thod and 
findings, Gribbons' and Lohnes' Career Development Study essentially confirmed 
in eighth, tenth, and twelfth grades the findings reported by the Career Pattern 
Study. In studying occupational plans ajid the outcomes of vocational guidance, 
in several Wisconsin high schools, Rothney (1958) also confirmed the instability 
of early adolescent choices as did Flanagan and others in Project TALENT 
(Flanagan & Cooley, I966; Cooley & Lohnes, I968). 

The above work has been synthesized by Myers and Jordaan (1970), Super 
(1969, 197^), Super and 3ohn (1970), and Crites (1969). Evaluations of these 
projects and contributions have also been published by Osipow (1968). 

The challenge of ECES development was to create a system which wovild 
influence the vocational maturity of its users. The system is therefore less 
concerned with occupational choice — and presiimed efficiencies thereof — and 
more concerned with fostering the development of choice making, resource use, 
and self concept implementation. 
The Montclair Field Trial 

As the system developed within the confines of IBM's Advance Systems 
Development Division Laboratory in Yorktown Heights, New York, frequent trials 
with subjects of high school age were carried on (e.g. Pilato & Myers, in press). 
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With the development of what appeared to be adequate hardware, a procedirre for 
storing information, a series of appropriate data bases, and a means by which 
individuals could engage in a meaningful excheuige vith the data base, the time 
cai?ie to address the basic questions of hov SCSS would work in tb' field. What 
effects would it have on its users, wha"; reactions would it evoke from students, 
counselors, teachers, and parents? 

In January of I969, ECES was installed at the high school in Montclair, 
New Jersey for its first field trial. For one semester, the system was used 
by a sample of 160 students selected so as to represent all high school grades, 
males and females, black and white students, euid college-bound as well as non- 
college-bound students. The findings which are briefly reported here are 
described in detail in Thompson, Linderaan, Clack and Bohn (1970). 

1. Did the, system function adequatel y? The findings demonstrated that 
the system could be installed and maintained in a community high school 
with relative ease. After the removal of the inevitable minor technical 
problems, the equipment required little special maintenance. It T;as 
also established that ECES covild be used in ongoing high sohool guidance 
progrfimfl without interference with class work and other activities • 

2. Was ECES appropriate for the target population ? The trial air 
established that the system was applicable and appropriate for students 
within a wide remge of ages, grades, intellectual levels and socio- 
economic backgrounds. Most of the students could use the system after 

a brief orientation, b\rt the need for a clerical level monitor to assist 
the students was clear. There was robust evidence that the students not 
only could use the system but also did so with a good deal of enthusiasm. 
The data on the use of the system revealed that it was appropriate over 
the entire range of students in the trial. Ninth and tenth grade non- 
college -bound males used it most and black non-college -bound females 
used it least. Attendance records suggested a high degree of motivation 
among the users. 

3. What effect did the use of the system have upon the vocatloneJ. develop- 
ment of students? The data indicated that users gained significantly 
•on a scale measuring how much specific knowledge a student thought he 
had concerning occupations. Other measures of vocational maturity were 
not affected, nor was realism of vocational and educational self concept. 
Changes were observed in a variety of students* attitudes toward sources 
or job satisfaction, as measured by the Work Values Inventory (1970). 
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^* What did the students think of BCES ? In general, the study of student 
attitudes toward BCES revealed that the majority of students enjoyed 
working with the system, found the material easy to read and to under- 
stand, and felt that they made progress in thinking about their future 
as a result of each session with ECES. The non-college-bound students 
received more help than the college-bound in finding out about courses 
they might take in future education or training, about high school 
majors they should consider, and about information on colleges and vo- 
cations which they might like to consider. The non-college-bound also 
reported receiving more help in seeing the relationship between their 
interests and abilities and possible occupations. There was some 
suggestion that the black students had more difficulty in the beginning 
in using the system, but as they became more accustomed to the system 
the black students frequently reported getting more help than did the 
white students. Similarly, the male students experienced more diffi- 
culty than did the female students in understanding the operating manual 
but reported that they had received^ore educational information than 
the females did. In general, the earlier grade levels, ninth and tenth 
grades, were more consistent in the help they reported that they got 
during the sessions. 

5. What did the parents think of ECES? Over h^Llf of the parents reported 
that there was considerable discussion with their children concerning 
ECES. About 60^ reported that they had become more involved in their 
child's planning. Like their children, the parents considered SCES 
particularly useful in getting important facts about occupations and 

in seeing connections between personal characteristics and occupational 
possibilities. About three -fo\irths of the parents felt that their 
children were able to make better career decisions as a result of 
having used ECES. Most people felt that the system should be available 
in the seventh, eighth, ninth and tenth grades. Almost eight of ten 
parents believed that if BCES were available they would want their 
school district to get it as soon as possible. Almost 70^ of the 
parents felt that there should be more emphasis on educational and 
vocational guidance in the schools than there is now. 

6. What did the counselors think of ECES? In general, the counselors 

did not think that a 3-month trial of BCES had produced extensive changes 
in their own working patterns. They reported that the effect of t!ie 
system was seen in increased activities in other aspects of the guidance 
program, particularly in the use of the occupational library. They 
stated that the most visible outcomes were seen in the occupation* _ \ad 
educational plans of the students. Usually the effect of BCES was seen 
as promoting higher and more appropriate occupational plans and goals. 



The Genesee County Field Trial 

Armed with the information that ECES could work in a high school and 
could have useful effect*? on its users, the developers set about to conduct 
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a longer term field trial encompassing larger numbers of students and more 
schools. An agreement was reached between IBM and the Genesee Intermediate 
School District (GISD) to conduct an extensive trial of ECES as it was revised 
on the basis of the Montclair trial and modified to fit the local realities of 
Genesee County, Michigan. A team of psychologists from Teachers College, 
Columbia University was engaged to conduct the assessment of the field trial. 

The ECES configuration tised in Genesee County contained three sections: 
occiq?ationS ) consisting of kOO occupations representing many fields and levels; 
majors , consisting of 300 post-high school, college atnd other training program 
majors; and charts , which smmnarize €md competre information about the student 
and his explorations on the system. These three sections are available to the 
student in an interactive mode. The terminal ^ich the student uses consists of 
a film image display unit, which presents relatively static information ajid 
questions, and a typewriter, "vrtiich presents individvialized information to a 
students. In addition, a post-high school program locater called College 
Finder is available for use without the terminal. 

In Genesee County ECES was powered by an IBM model 360«UO computer located 
at GISD headquarters. The terminals in the field were connected by remote 
data link. 

The plan for the first year of the field trial was to work through the 
technical difficulties connected with using ECES for large numbers of students, 
to construct and evaluate instruments for the assessment of ECSS use, and to 
explore the ways in which ECES might best fit into existing guidance services. 

The students participating in this first year of the field trial were 
tenth graziers ?n twenty-five public high ^;chools in Genesee County, a major 
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automobile manufacturing area with a population of U50,000 dominated by Flint 
with a population of 195,000. To be considered eligible for using ECES, a 
student had to have on file with the GISD a grade point average from the previous 
year, and complete scores for the Ohio Vocational Interest Survey and the Vocational 
Planning Inventory. Both instruments were used in producing a search strategy 
to help students use ECES. The Vocational Plcuining Inventory also provided 
a predicted high school grade point avereige as a measure of leairning ability 
used in the system. Of the 9,UU8 tenth graders in the county in 1970-71, 5,587 
or 59^6 met these criteria. All of the students were eligible to be included in 
the data collection. 

The schools in the county were paired with regard to size, socio-economic 
level, location, ethnic composition, number of counselors, and drop-out rate. 
For each pair a coin was tossed to determine which would be experimenteuL and 
which would be control. In the final analysis, the experimental schools had 
3,201 sophomores in the study while the controls had 2,386. 

Students at both the experimental and the control schools were given the 
Career Development Inventory (CDI) (1972) at the beginning of the school year 
€md again at the end. In addition, all students who used the system were given 
a student reaction form. A seunple of system users and their parents were sent 
questionnaires at the end of the school year.. All of the counselors at the 
experimental schools were interviewed by the evaluation te^im. 

The terminals were located in a central place at GISD headquarters. The 
students were brought to the terminals by bus. The results from the first year 
of field trial in Genesee County are reported in detail in a preliminary report 
(Hvers, Lindeman, Forrest, and Super, 1Q71) and are briefly summarized here. 
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!• Hov vas ECES used? The way in which students used ECES is difficult 
to describe because of the variety of ways in which ECES was available 
to them. Most students used the system at the terminal location at 
GISD where they were taken by bus. After some students had begun using 
the system for 55 minute periods, the procedure was changed so that 
students were scheduled to use it for two two-period block sessions, 
with no opportunity for further use. In addition, two of the schools 
had their own terminals away from GISD and they worked out their own 
use patterns. 

Combining all of the students who used BCES during the first year of 
the trial, regardless of where and when they used it, it was found 
that less than 6^ of them had an opportunity to use it for more than 
four hours. Forty-four percent used it for four hours, and more than 
hCLLf of them used it for less than four hours. The Montclair field 
trial demonstrated that when students were free to use the system 
as much as they wanted, they used it for a mean of 6.7 hours each. 
Clearly, the constraints of the GISD field trial prohibited this much 
exposure . 

2^ What did the students think of BCES ? The most important observation 
to be made from the student reactions after using ECES is that the 
great majority of them indicated highly favorable reactions to all 
aspects of the system. The physical features of the system were seen 
as easy to use. The systeti was judged to explain ideas, occupations, 
and majors clearly. The charts were considered helpful. The system 
was seen as being helpful with educational and occupational planning. 
The overall reaction was overwhelmingly favorable. 

3. Were there effects of using ECES on vocational maturity ? When BCES 
users were compared on the CDI, a measure of vocational maturity, it 
was observed that BCES users tended to show slightly greater improve- 
ment than non-users in terms of the quality of potential occupational 
resources they knew about and the quality of occupational resources 
they actually used. The differences, while they were statistically 
significant, were small. Forty percent of a sample of students who 
were surveyed about their reactions to BCES indicated that they tho\ight 
the use of BCES had resulted in a change of plans. Another 2% was 
not sure. Seventy-two percent of the students saw themselves as being 
either rather definite or very definite about the: plans, and only 
3^ saw themselves as uncertain. Clearly, the vast majority of these 
students reported that they were more definite about their plans after 
having used ECES. 

^. What did the counselors have to say about ECES ? Considering counselors 
reactions to the effects of BCES on students, it was clear that most 
of the reactions were positive and supportive of the system's efficacy. 



U. (Cont'd.) Although the students were seen as benefiting from ECES, the 
counselors were not totcilly uncritical when viewing some of the spe- 
cific aspects of the system. Counselors views of ECES hardware, 
scripts, and the mechanics of the field trial were also generally 
positive. Most of the counselors agreed that ECES created more work 
for them though this fact may have been more a function of the evalu* 
ation procedure than of the system itself. A large number agreed 
that ECES had caused them to do reading that they would not have 
otherwise done, ajid about one-third of the counselors reported that 
they h€id been stimulated to do some independent local research on 
ECES users. 



In general, counselors approved of ECES when they were asked to conside 
its effect on students and when they were asked to look at the specific 
of the system. The presence of ECES and its evaluation have brought 
about some positive chsuiges in the counselors job activities. 

Thotigh the findings reported above are of obvious interest, the main 

value of the first year of the field trial was the development and refinement 

of the reseELrch procedures and instruments. Principal among these was the GDI 

(1972), a valid and reliable measure of vocational maturity, which will be 

described in a later section. 



II. THE ASSESSMENT PLAN 



The Montclair field trial of the Educational and Career Exploration System 
(ECES) answered basic questions about the system's suitability for use with 
high school students and provided a basis for revision. The preliminary work 
in Genesee County resulted in a number of important guidelines for the conduct 
of the field trial in 1971-1972. 

To begin with, it was clear that vocational maturity — i.e., planfulness, 
knowledge of resources for planning, €uid decision making skill — could be 
measured reliably by the Career Development Inventory (CDI). In addition, the 
experience had shown that because of the difficulties in coordinating the 
effort? of so many counselors in Genesee County, certain of the data collection 
methods that had been tried in 1970-1971 wex^e clearly impractical. Finally, 
there was knowledge that users of ECES did not show demonstrable gains over 
non-users in vocational maturity. Because of the preliminary nature of the 
first year's effort, it was not easy to decide whether the lack of BCES effects 
was a trustworthy finding or an artifact of a variety of shortcomings known 
to exist in the early field trial. Therefore, the 1971-1972 plans for the use 
and CBBsessment of BCES were altered in attempt to desLL with these shortcomings. 

The 1971-1972 Plan 

1. Terminal location . Though a central location for the BCES terminals 
solved some administrative problems while the system was being installed and 
tried on a large scale for the first time, it created problems of other kinds. 
Inevitably, transporting students from their schools to a central terminal 
location involved difficulties in scheduling and a consequent reduction of the 
total time vhat some students had access to the system. Even more important, 
the counselors at the schools were more detached from the innovation than they 
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should have been because ECES was not visibly a part of their own guidance 
services. It was, instead, a county-wide service to which they were 
obliged to deli\'er the bodies. 

For I97I-I972, the terminals were located in the schools. As before, 
the schools were paired according to size, socio-economic level, location, 
ethnic composition, size of counseling staff, and drop out rate. From each 
pair, one school was randomly designated experimental and the other control. 
Terminals were located at the experimental schools, thirteen in all. 

2. Student use time . During the preliminary trial, certain advantages 
were realized by attempting to expose all tenth graders in experimental schools 
to the system. However the number of terminals available for the field trial 
made this possible only if each student had access to the system for a limited 
time. The result was that very few students (6^) had the opportunity to use 
ECES for more than four hours. In the revised plan, counselors were urged 

to get as many students as possible to use the system, but not to attempt to 
expose the entire tenth grade to it. Furthermore, each counselor was asked 
to make it possible for some students to use the system as much as they wanted. 

3. Delayed effects . The developmental nature of vocational maturity ' 
naturally leads to the question of delayed effects. That is, the possibility 
was recognized that exposure to ECES had stimulated processes whose effects 
would not necessarily be observable immediately after that exposure. If the 
new experiences gained by the user were to lead him to be more planful, better 
informed about planning resources, and better able to make decisions, the 
increases might begin rather slowly and become manifest only after some time 
had passed. Logic suggests that delayed effects might be especially important 
as a user moves from his tenth-grade year to his eleventh-grade year, when 
considerations of the future begin to increase in urgency. 

O 
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To assess the possibility of delayed effects, a sample of eleventh-grade 
students who had used ECES during the tenth grade was tested and compared to a 
sample of eleventh-grade students from control schools. 

^. Counselor resources . During the first year of the field trial (1970- 
71), all counselors in experimental schools were given intensive training about 
SCES. The purposes, contents, logic and operation were all carefully reviewed. 
The strategies for its use were also covered, including suggestions for how a 
counselor might (a) prepare a student to get the! most fron using SC3S and (b) 
help a student benefit from his explorations after using it. After these train- 
ing sessions, relatively little was done by the project staff to guide the 
counselors as they incorporated this rather radical innovation into the oj )ing 
guidance services at their individual schools. 

What resulted was considerable variation in counselor activity related 
to ECES. Some counselors conducted formal pre -ECES orientations for their 
students, but most did not. Some counselors conscientiously followed each 
ECES user to assure that the experience gained would be appropriately inter- 
preted and acted upon, but most did not. Some counselors maintained an active 
interest in the progress of the field trial, but many did not. Observation 
of this variation in counselor activity led the project staff to the conclusion 
that a critical test of ECES effectiveness ought to include a trial of how 
ECES works when supported by a comprehensive program which guides the counselor's 
activities step by step. In order to accomplish this, the Decision Making 
Syllabus was created. 

5. Decision Making Syllabus , The Decision Making Syllabus (DMS) was 
developed to provide counselors and students with a systematic skill acquisition 
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program for use in conjunction with ECES. DMS focuses on the acquisition of 
skills in four areas: 

a. identifying career decision points 

b. identifying sources and types of information 

c. applying a systematic decision making model 

d. developing a tentative career plan 

It consists of detailed instructions for the counselor and the student covering 
three individual sessions, ten group sessions, and four visits to the ECES 
terminal. The units of the syllabus include such things as learning about 
occupational classification, orientation to ECES, reviewing SCES charts, 
evaluating one's progress, developing career plan strategies, and so on 
(Friel, 1972a). 

From the counselors in experimental schools fourteen were chosen to 
conduct DMS groups of students at their schools. The counselors were chosen 
on the basis of their interest in and enthusiasm for the ECES field trial and 
their skills at interpersonal functioning. These counselors participated in 
a two-week intensive training experience during which the contents of the DMS 
were reviewed, revised and adapted to the realities of the individual schools 
represented by the counselors. The training experience also included training 

in interpersonal skills. 

The counselors were each instructed to select for their DMS groups fifteen 
students who would show up re^arly and do the work. They were also asked to 
pick students who had not already made all of their career decisions, who could 
read, and who were capable of participating in a group meeting. 

The result of all of this was that a small group of counselors, chosen 
for their skills and enthusiasms, implemented the DMS with small groups of 
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stulents, chosen for their probability of completing and benefiting from the 
syllabus. The purpose was to demonstrate the usefulness of ^CES used in 
conjunction with the DMS under the best of available conditions. 

For the purpose of contrast, an approximately equal number of counselors 
in experimental schools were asked to identify fifteen students each who 
would experience ECSS without DMS. A third group of counselors and students 
from control schools was also idcntifi'^d. 
3uiTunary 

The assessment plan for the 1971-197? ECES fi'^ld trial •consisted of 
the followinf^: > 

1. A comparison of tenth graders who used ECES with a comparable group 
of tenth graders who did not, with regard to changes in vocational maturity. 

?. An analysis of the relationship between change in vocational maturity 
and time spenL 't.ving ECES. 

3. A comparison of eleventh graders who had used ECSS in the tenth grade 
with eleventh graders v7ho had not, with regard to possible delayed effects upon 
vocational maturity. 

U. A comparison of tenth graders who experienced the DMS with tenth 
graders who experienced ECES-ONLY and controls on vocational matiurity. The 
DMS and ECES-ONLY groups were also compared on career planning skills, and a 
variety of education-and career-related behaviors. The parents of these two 
groups of students were also surveyed. 

5. An assessment of counselors' reactions to the DMS and ECES-OfFLY 
experiences. 
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III. RESULTS: VOCATIONAL MATURITY ] 

< 

I 

This section presents the results of the 19'a-72 field trial of Educational 
and Career Exploration System (ICCES) conducted by the Office of Vocational and 
Technical Education of Genesee Intermediate Schoo] District (GI3D) in 1971-1972. 
The results are presented in two parts. The effects of SCK3 on the vocational 
maturity of the tenth-grade users and the delayed effects on eleventh graders 
who used ECES in the tenth grade are included here. The assessment of the 
use of the Decision Making Syllabus (dMS) is covered in th'i next chapter. 

Vocational Maturity of Tenth-Grade Users 

Instrument , The basic assumption justified by the work of the Career 
Pattern Study (Super Sc Ovsrstreet, I960; Jordaan & Heyde, in process) and the 
Career Development Studies (Gribbons & Lohnes, 1Q68, I969), is the adolescent 
years are for most boys and girls years of vocational exploration. The career 
development of most youths has not progressed to a point which makes definitive 
and lasting vocational choices possible. . The decision process needs instead 
to be viewed as one of choosing, trying out, and evaluating the implications 
of a sequence of exploratory activities. Programs and services of educational 
and vocational guidance in junior and senior high school should then have as 
their main objectives the creating of awareness of the role of work in the lives 
of men and women; orientation to the world of work and of occupations; familiar- 
ity with the resources useful in exploration; the development of aptitudes, 
interests, values, self -knowledge, and self -understanding^; knowledp:e of how to 
makf; career decisions; and practice in making them. The Career D^^velopment 
Inventory (CDl) doe? not attf^mpt to asses.-: tpe decree to 



ERLC 



which all of these objectives have been attained in adolescence; to do so 
would require more time than is generally available- for testing in the 
evaluation of projects. 

The CDI used in this project assesses three of the important desired 
outcomes of career development and vocational guidance programs: l) the 
development of a planning orientation towrad a career; 2) familiarity with 
and use of resources which can be useful in vocational exploration; and 3) 
knowledge of occupations and of career decision making principles. Its three 
scales do this reliably and with some evidence of validity. 

Scale A, plannin/g orientation, represents the degree of inforined plan- 
fulness; it involves relating information about oneself and potential 
vocations, but it need not, however, result in firm plans. It includes 
measures of concern with choice, specificity of planning, and self-estimated 
amount of occupational information. It is a self -rating scale which reflects 
a planning approach to a career, an attitude in resulting knowledge and 
actions ♦ 

Scale B5 resources for exploration, represents a self rated assessment 
of the used and available resources for use with these planning activities, 
resources from which a student learns about educational opportunities, 
occupations, and himself. It too reflects attitudes, attitudes of concern, 
inquiry, and trial. Specifically, Scale B is a measure of the auality of the 
actually used and the potentially usable resources for career (educational and 
vocational) exploration. 

Scale C, information and decision making , unlike scales A and B, is a 
cognitive measure as shown by correlations with verbal intelligence and grade 



point average. It assesses the student's possession of actual occupational 
information and his knowledge of how to integrate personal and occupational 
information into educational and vocational decisions. While Scale A repre- 
sents the degree of the students awareness and of inclination toward planning 
and choice, Scale B thus assesses the quality or soundness of individually 
ust ^. and potentially available resources , and Scale C samples the amount of 
educational and occupational information the student has acquired together 
with his mastery of the use of information for sound decisions. Thus both 
attitudina.\ (self-rated and subjective) and cognitive (factual and objective) 
aspects of vocational development are tapped by the instrument. 

Subjects . As was mentioned previous.ly, the secondary schools of Genesee 
County, Michigan were paired on the basis of size, socio-economic level, loca- 
tion, ethnic composition, size of counseling staff, and drop out rate* By a 
flip of a coin,, one school from each pair was designated as experimental and 
one as control. The schools and their designations are listed below. 



Experimental 


Control 


Flint Northern 


Flint Central 


Flint Northwestern 


Flint Southwestern 


Ainsworth 


Carmen 


Svrartz Creek 


Davison 


Beecher 


VJestwood Heights 


Kearsley 


Flushing 


Grand Blanc 


Clio 


Lakeville 


Mt. Morris 


yenton 


Bentley 
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Atherton Montrose 
Bendle Linden 
Goodrich/Genesee LaHe Fenton 

An ECES terminal was located at each of the experi::iental schools. Trained 
monitors, in most cases students from the schools, were provided. Counselors 
were instructed to assign students to BCES according zo whatever use strategy 
the covmselors preferred, except for the lU counselors who were conducting 
DMS groups. 

In total, 1886 tenth grade students used ECES during the school year. The 
amount of use time ranged from less than 1 hour to more than 17 hours. Tho 
moan use time at th^> various experimental schools ranged from 1 hour and 30 min- 
utes to U hours and 50 minutes. The overall mean was ? hours and 50 minutes. 

Not all of the I886 users are included in the analyses that follow, 
because data were not available for eill of them. 

At the beginning of the academic year counselors at all schools, experimental 
and control, were asked to administer the Career Development Inventory (CDl) to 
all tench grade students. This administration, referred to as the CDI pretest, 
resulted in 10,U89 students being tested. Near the end of the academic year, 
the counselors were again asked to administer the CDI. While all the counselors 
complied, they were not able to give the po'ittest to all the students who had 
tt^ken the pretest. The CDI posttest yielded 2?U5 usable tests, ?92 from experi- 
mental schools and IU53 from control schools. The possibility of some systematic 
bias having influenced the reduction of the population from 10,U89 to 22U5 
cannot be assessed, but none is suspected. 

In the analyses reported in Tables 1 through 12, users are those tenth grade 
stU'jenls who actually used ?£K3 ani for whom usablr> CDI pretests ami p sttests 
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v;ere -available (K=?92): contro ls are students from control schools f'jr vhorn 
usable CDL pretests and posttests were available (ir-IiT^S)^ 

Tenth-Grade Users vs> Controls 

Results vOf analyses coniparinir tenth-nrade users v:ith controls on GDI 

scales A, B, and C are presented in Tables 1 through 6. Analysis of 

1 

covariance (Winer, 19^2) was used for all such comparisons in order to provide 
an adjustment for possible initial differences on GDI pretest scores betv;eer. 
the user and control groups. Thus, the analysis of posttest results on each 
scales was a two-way (Treatment Group by Sex) analysis of covariance with the 
corresponding GDI pretest scale serving as covariate. 

Scale A, Planning Qrieii^ation . Reference to Table 1 shows that the 
adjusted moans on GDI Scale A are somewhat lai-gcr for ECBS users (lO^-.i; for 
males and 105*9 females) than for controls (102.6 for males and 103*2 for 
females). The results of the analysis of covariance in Table 2 indicate that 
this difference is significant at the .01 level (F=9*6). Furthermore, the 
differences between pretest and posttest means is larger for EGBS users than 
for controls. These statistics indicate that the users had larger gains than 
controls in terms of planning orientation during the period of the study. Note, 
however, that the difference between users ond controls was relativei2/ small, 
about one-tenth of a standard deviation unit. 

Scale B, Resources for Exploration * EGES users also showed significantly 
larger gains than controls in terms of choice and use of resources for occupa- 
tional exploration. A.^ c^een in Table 2> adjusted means for users were 2k'i.B 
(males) and 25^.1 (females), as compared with 2UO.0 (males) and T.Vf ^2 (females) 
for controls. Table h shows that the difference was significant at the .01 
level. The average gain for usevs was about 13 points compared to about 6 points 

^?p"»he computer prograra useci was BMDx6U, General Linear Hypotheses. 
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for controls. Again the difference between mean gains of users and controls is 
relatively small, amounting to slifchtly more than one -tenth of a standard devi- 
at ion . 

Scale C, Information and Decision-Making, As seen from Tables S and 6, 
.lifferences in adjusted nieans between users and controls on Scale C were very 
small and were not statistically significant* 

Summary of Tenth -Grade User vs. Control Differences , Compared with 
controls, [•rEo users showed sijrnif icantly larger r.ains in both de.c:ree of 
pj.anninn orientation and in choic* am: us'^ of r'^sourre.s for occupational 
exploration, but not in information and decision makin^^ Assuming that all 
other enyiromaental factors were essentially similar for BCr^S users and controls, 
one .vAY conclude that the differences observed were due to the effect of the HX^ES 
pro-^ram compared with the usual guidance program operating in the control schools. 
Thus, the use of ECSS in conjunction with the reGT^ilar guidance program may be 
judired to have a relatively small but clearly positive effect in promoting 
aspects of vocational niaturity measured by GDI Scales A and -3. 

Tenth-Grade Males vs. Females , 

vmile the major purpose of the analyses was to compare SCES users with 
Controls, it is also of interest to note differences in CDI performances between 
male and female students. Such differences may be observed by reference to 
Tables 1 through 6. 

There were no significant differences between males and females on Scale A, 
but females did noticeably better than males on Scales B and C of the CDI. As 
shown in Table 3, adjusted means for females on Scale B were ?5^.1 (Users) and 
2U0.O (Control) for males, the difference being significant beyond the .01 level. 
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Table 5 shows that female users ann controls both had an adjusted mean of 17.0, 
while males had means of l6.2 (Users) and 16.9 (Controls), sip^nificant at the 
.05 level. These results indicate that females in both user and control .c;roups 
showed rroater stains than males durinj^ the perioci of study both in resources for 
exploration and on information and decision -making. 

It should be mentioned that in the analyses reported in Tables 1-6 there 
were no significant Interactions between treatment group and sex. Thus, there 
is no evidence that the effectiveness of SCSS is dependent on sex. 
Relationship Between ZCES Use Time and GDI Scores 

Results of analyses in the earlier Montciair SCSS field trial suggested 
that there should be a positive relationship between the students GDI scores 
and the amount of time he used ROES. In the first year of the GISD trial 
(1970-71) this hypothesis could not be tested because of the central location 
of terminals and the consequent limitation on optional usage of the system beyond 
the scheduled hours. In this second year, however, with terminals located in 
the experimental schools, students had access to the terminals on an optional 
basis and many took advantage of the opportunity to spend additional hours on 
the system. 

EGBS users were first divided into eight subgroups on the basis of hours of 
use time. The categories are indicated in Table 7. Analysis of covariance was 
used to compare GDI means of the eight subgroups on Scales A, B, and G. The 
results are presented in Tables 7 through 12. 

Table 7 shows that the adjusted means on GDI Scale A tended to increase 
steadily with increased use time. For example, those who used ECSS less than 
one hour had a mean of 98. 1 while thcso ^jdents using the system for 6-7 hours 
had a mean of II8.I. Table 3 shows that differences amon,<^ the means are 
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significant at the .01 ?.evel. The fact that there was a slight drop in the 
mean for those using the system more than seven hours (112.9) sugf-ests that 
there may be an optimal maxinum use time. However, the data are not suffi- 
ciently complete to permit the determination of such a value. 

There were also significant differences between adjusted means of use 
time groups on Scale B, as shown in TablPo 9 and 10. Again, there appears 
(Table 9) to be a steady increase in the adjusted mean as use time increases, 
with a slight drop occurring for those using SC3S more than seven hours. The 
pattern is consistent with that on Scale A. 

There were no significant differences in adjusted means on S'^ale C, as 
can be seen in Table 12. The adjusted means in Table 3.1 exhibit a trend similar 
to that for Scales A and B, but differences are very small. 

These results indicate that> as might be expected, the longer a student 
uses ECSS, the more he gains in terms of planning orientation and resources 
for occupational exploration. However, it shoxad be pointed out that those stu- 
dents who were in the higher use-time categories generally had higher pretest 
means on Scales A and B than did those in the lower use-time categories. 
Therefore, one could argue that those in the higher use-time categories were 
more likely to gain more from using SCES because of stronger initial motivation. 
The results thus provide a strong argument for providing optional time on ECES 
to those who want it. They seem to get the most benefit from the system. 

Delayed Effects on Eleventh-Grade Users 
In a previous section two points were made that deserve repetition here. 
The, first is that during the first year of field trial, tenth-grade ECE.S users 
■lid not show important changes in vocational maturity. It was difficult to 
know whether this finding was trustworthy or merely the conseauence of a variety 
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of shortco.-nings known to exist in the beginning field trial. The second point 
Is the rocopinition of the possibility that the use of SCES might have stimulated 
'Effects which i:ere not immediately observablf^ but which would appear at a 3ator 
point 5n time. Tho analysis described below represents a search for such 
delayed effects. 

Subjects . From the eleventh-grade students who had used SCES as tenth 
traders in 1970-1973 and who had usable GDI posttests, (taken at the end of 
their tenth ^^i-ade) 200 cases from three experimental schools were selected. 
Another 200 cases, also with usable tenth grade GDI posttests, were selected 
from tho matching control schools. The counselors in the six schools were 
provided with lists and asked to administer the GDI to these ^00 eleventh .f^raders 
near the end of the 1971-72 school year. 

This data collection resultec^ in 32U usable GDI's for eleventh graders, 
53 who had used SGSS and 71 controls. Once again the reasons for the shrinkage 
from *^00 to 12^ are not known, but no systematic basis is suspected. 

Analysis . Analysis of the eleventh-grade GDI data again employed a 
two-way analysis of covariance with treatment and sex as independent variables. 
The covariate was the GDI posttest which the current eleventh -grade students 
took at the end of their sophomore year. The results of these analyses are 
presented in Tables 13 through iP. 

Tables 13 and Ih show that there were no significant differences among 
sub-groups in adjusted means on GDI Scale A. Means for females are slightly 
larger than for males, a finding observed among the tenth-grade students. 
Although the difference is about one-third of a standard deviation, it is not 
significant due to the much smaller number of eleventh-grade subjects on whom 
data were available for analysis. 
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Differences between males and females reach significance on Scales B and C, 
as seen in Tables 15 through l8. ICleventh-grade females are seen in Table 15 
to have adjusted means of 2?8.2 (Users) and 263.8 (Control), compared with 
2U5.2 (Users) and 250.2 (Control) for males. The difference is significant at 
the .01 level. This finding indicates that during the eleventh -grade year 
females improved more than males in terms of choice and use of resources for 
occupational exploration. Tables 17 and I8 show the, same trend in means on 
Scale C, but the difference is smaller. One may conclude that females also 
improved more than males in t«rms of decision making skills and in occupational 
information. 

The only significant difference between p^roups involving the treatment 
(User vs. Control) appears in Tables ]? and I8 on Scale C and consists of a 
significant interaction (P<.05) between treatment and sex. The reason for this 
result can be seen by examining the adjusted means in Table 17. Note that for 
males the difference between Users (19-3) and Controls (17. O) is about twice as 
large as for females (19.^ for Users and 20.6 for Controls) and is in the 
opposite direction. This is the only finding in either tenth or eleventh 
p;rades which suggests a differential effect of ECSS involving sex. While the 
finding should be noted with interest, it is of doubtful theoretical or 
practical significance. The weight of evidence suggests that CCES is about 
equally effective for males and females. 

In summary, the above results fail to reveal possible delayed effects on 
vocational maturity about which there was some speciUation following the first 
year of the Genesee County field trial. Considering all of the evidence now 
available, it nef^mr, mor>t rfiasonahV- to ronolune that th'^ failure to find po5^ii1ve 
]iCh]3 effects during' tlK- first y<^ar waii due to insiiff icient exposure to th<} 
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system, rather than to the presence of real effects which were not immediately 
observable. 
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IV. RESULTS: AN ASSESSMENT OF THE DEMONSTRATION 
PROJECT USING THE DECISION MAiCTlTO SYLLABUS 

Demonstration Project^ 

In retrospect, it has become obvious that the developmental history of 
ECES (Friel, 1972a) re-eraphasizes the principle that people do best what they 
are systematically trained to do (Carkhuff, 1971a; 1971b). Specifically, the 
developments of the first version of BCES at Montclair, New Jersey demonstrated 
that students who were systematically exposed to career facts and career concepts, 
exhibited an increased araomit of such facts and concepts, but did not exhibit a 
greater amount of career decision-making skills (Thompson, et al. 1970). The 
reason for this was that ECES was not designed to provide skills training 
experience for the student, even though its developers hoped that skills general- 
ization would occur from exposure to factual and conceptual experiences. The 
1970-71 trial of ECES at Genesee County, Michigan, again failed to develop 
career dec isior>- making skills, but did deliver precisely what it was designed 
to deliver - an awareness of the principle that decision-making skills represent 
an essential ingreiient in effective career development. 

ECES demonstrated that career insights and attitudes, while complementary 
to skills acquisition, do not, alone, systematically and predictably translate 
to behavior change in the areas of career decision-making skills. Again, the 
developers were persuaded that if you want to effect career decision making 
behavior, you must systematically train career decision-making skills (Friel, 
Drake, Tyler, & Mallory, 1972). 



2. This part of the field trial was designed, implemented and reported by 
T.\K Friel of Eastern Psychological, Txiucational and Community Services, 
Amherst, Massachusetts. 
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Consequently, the Counselors and Students Guide to Career Decision 
Making Skills (DMS) (Friel, 1972a) was developed to: 

1. provide counselors with a systematic program to facilitate and 
direct his efforts to develop career dec is ior>- making skills in students; 

2. provide the counselor with a systematic program to maximize the 
students' exploration and utilization of ECES within the context of 
his career decision-making skills acquisition; and 

3. provide the student with a systematic program that increased the 
quantity of career dec is ion- making skills he needs to make more syste- 
matic and logical career decisions. 

The DMS Guides were designed to be used by those counselors who had 
received systematic Human Resource Development (HHD) skills training (Carkhuff , 
1969; 1972a; 1972b; 1972c; Carkhuff, Friel & Berenson, 1972; Carkhuff, et al., 
1972), and ECES utilization training. 

The HRD trained counselors, the DMS Guides, and the ECES terminal all 
comprise the present developmental phase ECES, called DMS (Friel, 1972). 

The hypothesis being tested in DMS is that systematically trained 
counselors, using a systematic program designed to develop specific career 
decision-making skills, can develop in students a greater quantity of these skills 
than comparable students can obtain through less systematic alternatives. 

The primary research design focused on three groups of tenth grade 
students: 

Group 1 • DMS Group (N=105) 
Used DMS Guide 

10 classroom sessions 
3 personal counselor visits 
^ ECES visits (approximately ^ hours) 
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Group 2 • ECES^NLY Group (N=87) 

Used ECES (approximately k hours) 

Saw counselor on regular basis 
Group 3 • Control Group (n=65) 

Did not use BCES 

Saw counselor on regular basis 
These groups were pre- and posttested using the Career Decision Making 
Skills test (Friel, 1972b, see Appendix) which was developed to assess: 

1. Specific career decision-making skills including: 

a. the quantity of occupational activities 

b. the quality of occupational activities 

c. the quantity of specific occupational decision-making information 

d. the quantity of unique career information soui*ces 

e. the quantity of general career information facts identified with 
career information sources 

f . the quantity and quality of occupational alternatives expanding 
skills 

g. the quantity of occupational decision making skills 

2. Student self -r^i port data on the impact of the training on the 
following aspects of his career planning: 

a. Ik specific career decisions 

b. the importance of career planning 

c. parental participation in career planning 

d. counselor utilization in career planning 

Also tested were the following groups of students: 

1. a randomly selected sample of students from f»ach of grades seven 
through fourteen. 
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These groups were pretested to examine the relationship between 
career decision-making skills acquisition and normal educational develop- 
ment. 

2. four groups of 11th grade students who had participated in the ECES 
field test in 1970-71: 

Group 1 - was exposed to HRD trained and ECES trained counselors, 
and used ECES. 

Group 2 - was exposed to ECES trained counselors and used BCSS 

Group 3 - was exposed to HRL trained counselors but had not used ECES. 

Group U . was a control group exposed to traditionally trained 
counselors but did not use ECES. 

These groups were tested to exe^ne any impact that their previous 

experiences may have had on their currenn level of career decision-making 

skills. 

3. A sample (N=20) of the Vocational Education and Career Development 
Service (VECDS) staff members from the Michigan Department of Education. 

This group was tested to provide an index of how professional adults 
would score when asked to answer the CI»4S test with specific reference 
to their present position, or the position for which they were preparing 
to enter. 

Data Analysis for the Demonstration Project > The data will be presented in the 
order of the CDMS test questions. Those items that are most directly related 
to career decision-making skills will be highlighted. The others wi].l be 
mentioned if the data reveal any relevant information, either positive or 
negative. 
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1. CDMS Item 2 - Number of occupational activities listed 

Figure 1 shows the average number of activities listed for the grades 
7 to lU base line control groups, the 1970-71 groups, and the three 1971-72 
experimental groups, DI^S, ECES-ONLY, and the control group. 3 jhe base line 
control scores suggest that 7-10 grades list fewer activities than 11-lU 
grades. The 1970-71 group^s scores suggest that ECES users list more activ- 
ities than 11-lU grade base line controls. 

The experimental scores indicate that the systematically trained students 
made a significant gain (t=3.M;, < .01) in the number of activities listed, 
and listed significantly more (t=3.0U, <.0l) than the ECES-OHLY group, 
which gained, but not significantly. After training, the lOth grade DMS 
students listed more activities than the ll-lU grade base line controls. 
2* CDMS - Item 2 - The quality of occupational activities listed 

Figure 2 represents the quality of the average occupational activity 
listed in Item 2 of the CDMS. The quality was rated on a sacle from 1 to 5 
where: 

1. an occupational activity that is true of all occupations and in no 
way helps discriminate this occupation from any other, i.e. get to 
wor?: on tiine 

2. an occupational activity that is true of this general type of 
occupation (similar work environment and duties) but does not dis- 
criminate within the work group, only between work groups, i.e. 
work with large machines outdoors 

3. an occupational activity that is generally true of a specific occu- 
pation, and helps to distinguish this occupation from others within 
its work group, i.e. take dictation and shorthand 

3* The means were calculated only from those students who responded to the 

items, hence the variation across items in the number of subjects per item. 
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k. an occupational activity that is specifically true of a specific 

occupation, helps to distinguish this occupation from others within 

its work group, and makes reference to the function of the activity 

within the occupation, i.e. use an IBM MIST to type letters and 

materiaU-s that will be changed frequently before final typing. 

5. an occupational activity that is specifically true of a specific 

occupation, helps to distinguish this occupation from others within 

its work group; makes reference to the function of the activity; 

and relates the purpose of the activity to a human benefit for other 

people involved in the activity, i.e. train students in the career 

decision-making skills they need to make more logical and systematic 

career decisions throughout their career pleuining. 

The base line control scores suggest that 13 and lU graders test higher 

quality activities, as rated, than do 7-12 graders. 

The 1970-71 groups* scores suggest the ECES users list equal or slightly 

higher quality activities, as rated, than do non-users. 

The experimental group scores suggest that the systematicedly trained 

students gained significantly (t=:5.2, <^.0l) in the quality of activities 

listed, and listed significantly greater (t=5.2, -^.Ol) quality ol activities 

than did the ECE5-0HLY or control groups. The DMS students also listed 

higher quality activities than did any other student group. 

3. CDMS - Item 8 - The quantity of specific kinds of occupational 
information necessary for decision making 

Figure 3 shows the q\xantity of occupational information that students 
listed as being important to know befo'^e deciding about a job. 



CDMS Item 9^ ^ The number of unique career information sourcer? listed 
Figure k shows the number of unique career Information sources listed 

by all student groups. 

The base line control scores suggest that higher grade students (l2-iU) 

list slightly more unique career information sources than do lover grade 

students (7-11). 

The 1970-71 group's scores that ECES users and non-users list approx- 
imately the same number. 

The experimental group scores indicate that systematically trained 
students gained significantly (t=U.5,^.0l) in their ability to list 
unique career information sources, etnd also listed significantly more 
sourc^L than the BCES-ONLY and control groups. 

The DMS students listed a greater quantity of unique career information 
sotirces than did any other student groups. 

3. CDMS Item 9^^ - The quantity of career information items that students ask 
of all of their career information sources 

Figure 5 shows the quantity of career information items that students 
ask of their caureer information sources to help them answer any questions 
or solve amy problems they might have. 

The base line control scores suggest that 12-lU graders score higher 
than 7-11 graders. 

The 1970-71 group's scores suggest that ECES users score similarly 
to non-users. 

The experimental group data suggests that systematically trained 
students gained significantly (t=3.33,<.01) in their ability to lisc a 



greater quamtity of career information items and also can list signifi- 
cantly more items than the ECES-ONLY and control students. The DMS 
students .listed a significantly greater quantity of items than any other 
student group. . 

6. CDMS I tem 10 - The cpxality of occupational classification and quantit 
of occupational alternative scores ' 

Figure 6 shows the student scores for CDMS Item 10. The scores are 
comprised of a 5-step question that asks the student to classify given 
occupations into a dichotoraous classification scheme, and then to add an 
alternative occupation to each of his classification cells. All classi- 
fication schemes were accepted, with schemes utilizing both external 
(i.^. personal interests) criteria receiving scores twice that of schemes 
using only external, or only internal criteria. 

The base line control scores suggest that 12-lU grade students score 
higher than 7-11 grade students. 

The 1970-71 group scores suggest that ECES users score higher than 
non-users. 

The experimental group scores indicate that the DMS students gained 
significantly (t=1.95, <.05) in their ability to classify and expand 
occupational alternatives, and also scored significantly higher (t=1.95, 
<.05) than the BCES-ONLY and control groups. 

7* CDMS Item 11 - The quantity of occupational decision making skills 

Figure 7 shows CDMS item 11, which evaluates the quantity of the 
students' occupational decision-making skills, giving one point for each 
decision making step the student takes in making his decisions. 



The base line control scores suggest that 12-lU gra^^ers score 
higher than 7-11 graders. 

The 1970-71 group^s scores suggest that ECES and non-users score 
at the same level. 

The experimental group scores indicate that the systematically 
trained students gained significantly (t=2.38, <.0l) in their quantity 
of occupational decision-making skills, and also scored significantly 
higher than the ECES-ONLY and control groups. 

The DMS students scored higher than all other student groups. 

8. CDMS Item 12 ^ the extent the student reports that he is prepared 
to make his career planning decisions 

Table 19 contains the means and standard deviations of DMS, ECES-OHLY 
and control students, for this item. While the data may well lend them- 
selves to detailed statistical analysis, the major finding from this 
entire item is reflected to greater or lesser relief by each of the 
fourteen items, and further supported by additional counselor data on this 
same item. 

Figure 8 displays the means and standard deviations for the first 
item, which exemplifies the major point for all of the rest. Pre- and 
posttested control students rate themselves at 3.5 and 3.9 respectively 
in terms of how well prepared they are to make their career planning 
decisions. On a pretest, ECES-ONLY and ms students rate themselves at 
the same level (3.5 and 3.5). 

However, on the posttest, the ECES-ONLY students were asked to re- 
rate themselves in terms of how prepared they really were before using 
ECES, now that they had used ECES and knew more about what was involved 



in career plsinning. The ECES-ONLY students rated themselves at 3.3 
pretest, and U.l as a result of using ECES. 

The D^5S students were asked for three post -ratings. First, a re- 
rating of where they were before they started (3.0). Second, a rating 
of where they would be if they only used ECES (3.6). Finally, a rating 
of where they were as a result of the DMS training (U.U). 

The data suggest that unsophisticated students (controls) feel they 
are fairly well prepared in making their career plans. Given an expo- 
sure to career facts, concepts and principles, (BCES-ONLY) students 
realize that they were not as well prepared originally as they thought, 
but that they are significantly (t=U. 5,^.01) better prepared as a 
result of their exposure. 

The more sophisticated systematically trained students, DM3, give 
themselves the same initial rating, 3.0. However, the DMS students 
place the ECES experience into a more discriminating perspective by 
suggesting that while they gained significantly from that experience 
(t=3.7, ^.01), the skills training itself provided an additional and 
significant (t=6.U, <C.Ol) contribution to their preparedness for career 
planning decisions. 

The implication is that self -report data is only as valid as is the 
level of functioning of the person who is self -reporting. This finding 
is consistently supported by similar research in the area of interpersonal 
skills, and human resource development skills training (Carkhuff, 1969; 1971a). 

Counselor evaluations of student preparedness on these same items 
supportn the nMr> students' ^Hnrrlmlnation. 
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■ The data in Table 20 represent counselor observations of 5U0 students 
I who had used ECES. The data were collected from nine counselors from the 
I ECES-ONLY and the 1970-71 groups' counselors. 

I Cleeurly, the counselors felt the students gained significantly from 

I their use of ECSS. More importantly, they tended to rate the control 

I students as low or lower than the students rated themselves, which supports 

I the principle that discriminations are accurate to the extent that the 

H ! rater is functioning effectively in the area being rated. 

I i 

I The counselors ratings are quite similar to the ECES-ONLY students' 

I post-SCES ratings, and to the DMS student post-ECES ratings. This 

■ suggests that all three groups see the ECES experience as similar and 

■ consistent benefits to the students. However, the fact that the DMS 

I students rate their experience at a significantly higher level suggests 

■ that their skills training is developing additional and significant benefits. 
I 9. CDMS Item 13 - Time spent talking to parents 

■ The data in Table 21 suggest that following use of ECES, and slightly 
I more so following the DMS training, that students reported a slight 

I increase in time spent talking with their parents. 

W 10. CDMS Item lU - Importance of career planning 

I 

I The data in Table 22 suggest that following the use of ECES, and signi- 

■ ficantly (t=5.55, <.0l) more so following the DMS training, students 
I report an increased importance in the need to plan and prepare for a 
I future career. 

■ 11. CDMS Item 17 - Counselor and parent utilization 

I After use of ECES, and significantly (t=U.5<'.0l) more so after DMS 

I training, students reported that they will be able to make better use of 

B talks with their counselors and parents about career planning decisions. 




The data are reported in Table 23. 
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Summary and Discussion , The conditions under which the systematic DMS training 
occurred were not ideal. The counselors received their DMS guides with less 
than lU weeks remaining in the Spring semester. Because of SCES scheduling 
pressures and graduation pressures on the posttesting of students, many counse- 
lors in the DMS group failed to complete the entire syllabus. On the average, 
6CH of the material was completed. It is to the credit of the extensive personal 
efforts of the counselors, administrators and GISD personnel that this demonstra- 
tion project was successfully brought to completion. 

Base Line Control Group . The data suggest a general, developmental trend 
of increased cetreer decision-^making skills acquisition occurring between the 7th 
and lUth grades. While the trend was never perfectly linear for all items, in 
general, higher grade students (12-lU) scored higher than lower grade students 
(7-10), with the 11th grade students (small sample size) fluctuating between 
the two groups. This suggests that 7-10 graders may not have reached the point 
of needing to address career decision making as seriously as 12-lUth graders, 
and that 11th graders are at the crisis stage where they are beginning to 
realize the increased need for such skills. 

The VECDS staff scores tend to support the developmental trend hypothesis. 

The 1970-71 Groups . In general, the data suggest that ECES users score 
slightly higher than do non -users on the CDf^S Items. It is important to empha- 
size that the ECES students were not systematically trained in any of the CDMS 
skills. Consequently, any gains they make are a function of their exposure to 
the ECES progreun itself. 

In general, the ECES users scored at or above the level of the eleventh- 
grade and base-line controls, and in the direction of the levels of the higher 
grade students. Similarly, the tenth grade ECES-ONLY students showed consistent 



movement upwards towards the levels of the higher grade students. The data 
suggest that the tenth-grade students' three-hour experience on ECES prepares 
them, although unsystematically, to score above the level of their inexperienced 
peers and at or above the level of higher grades (12-I3.1U) students. However, 
in comparison to the experimental groups, the 1970-71 groups suggest that only 
slightly positive effects can be expected in career decision -making skills if 
they are not systematically trained. Again, ECES students were not systematically 
trained in the CDMS skills. Consequently, we should not expect systematic be- 
havior change, only attitude and insight change. The 1970-71 counselors were 
trained to make a difference and they achieved that goal (Carkhuff, 1972c). This 
supports the principle that people learn best what they are trained to learn. 

Experimental Groups . The DMS students scored slightly higher on its pretest 
scores than did the ECES-ONLY and control students. This may be explained by 
the fact that the counselors informed the students about the program's purposes 
end goals before pretesting. This may have provided the students with greater 
motivation to perform well on the pretest. However, their higher pretest scores 
simply make any posttest gains that much more meaningful due to the higher base 
rate from which the students began the training. 

Table 2k demonstrates the order of group scoring on the pre- (23 comparable 
items) and posttests (29 comparable items), and also demonstrates the number of 
items that each group improved on from the pre- to postte sting. 

Clearly, the DMS demonstrated the greatest number of positive gains, with 
the ECES -ONLY groups second. 

The DMS students gained significantly in both career decision making skills 
and career planning attitudes and planning 'nsights. Where previous ECES efforts 
focused on attitudes and insights, they developed attitude and insight changes 
but not behavior changes in the form of improved career decision-making skills. 
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The DMS model focuseo primarily on career decisioi>-.7iaking skills and developed 
increased levels of skills in addition to the complementary attitude and 
insight changes. This suggests that to improve the student's Aill range of 
career attitudes, insights and skills ^ it is necessary to focus on career 
skills as the insights and attitudes will necessarily follow. Conversely, 
programs that do not focus on career skills will fail to deliver fully the 
desired results. 

Simply, the data indicate that tenth-grade ?tuder.ts can be systematically 
trained to score at and above the level of untrained .junior college students 
in the areas of career decision-making skills. 

The key ingredients in delivering the DI-IS model were: 

1. Counselors systematically trained to function at r'^latively high 
levels of ?TRD skills (DM:> Counselors - P.U; .-ICKS-ONLY Counselors - 1.8; 
Control Counselors - 3 .o) so as to improve their ability to relat*^ 
appropriately and effectively with students. 

2. Systematic programs that were desiccned under HRD principles to 

develop specific skills-based outcome objectives to students: 

a. ECES 

DMS guides 

This finding supports the HRD principle that effective development of 
human resources reouires the functional organization of HRD skilled people and 
systematic programs designed to deliver skills-baL^ed outcome objectives to 
those Dacking such skills (Carkhuff, 1971a; l<^"^?c). 

The major conclusion b'?ars repeaiinK: i^coplo (i^e. f^tudents) do hnsi. 
(i.o. career dec j sion-.mkin:/. skills) at vlial they are nyntemtically trained 
to do. Students train^^d in facts an. I concepts can only be expected to improve 
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their facts and concepts. Generalization Tr'^r. attitudes and Lnsightr> t:: 
skills did riot occur in any of tho SCKS pr;.:ects, rcBarcless of the hopeful- 
ness of the researchers, Sixiiarly, counselors did n:t :ieliver ^heir object- 
ives effectively unti] they vere provided \:izh tho 3k:lls and the, prr^c^ans 
they needed to do so. 

The implications for tomorr:)v:'s e.T.cr.::ir.r issues o:' career odara^icn* 
counselor aocountabi ity , and performance objective attairment are 'slciir. 
Counselors can be hela accjuntabie, for they can be evaluated and ^r'llnea in 
the HRD skills needed to deliver effectively to students (Carkhuff, l:)V:.ic). 
Porformanco objective attaia^ient is operationalized thr::urh the efi'e'S.lv.^ 
imjilementation of systematic, skills-based prcrrams delivered by HRD sk:ile/i 
people (Carkhuff, rriel ^ Berenson, 1972). 

The implications for career educati^. '^re also clear. 3y operational: zing 
career education objectives into concrete and obs8:*vable skills, it is nov 
possible to develop such career development skills in students (Fricl, ct al. 
1972). 

The DMS model offers a strong first step in the direction of delivering 
functional, career development skills to students, as well as demonstrating the 
principles upon which effective student resource development models can be based. 

h 

other Analyses 

Vocational Maturity . For a large number of the students involved in the 
demonstration project. Career Development Inventory (CDl) scores were available 
on a pre-post basis. The so-called Intensive Study Group (ISG), as described 
on pages t?U-3J, made up .-f students in the demonstration pr^jert wh-*^ had taken the 



At this point, the report of the Teachers Collcre ev?iluation tearp resumoo. 
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CDI, included 59 students who had received the DVS treatment, 6? who had 
received ^£ES ONLY, and who were desirnated as controls and received only 
the guidance services normally provided by their schools. An analysis of 
covariance of the CDI data \s^s used to det<;rnine whether statistically signi- 
ficant differences in vocational maturity between t-h'^se groups had occurred 
during the period of study. 

The results of these analyses are presented in Tables 25 through 30. 
Reference to Tables ?5 and ?6 shows that on CDI Scale A the DhlS group had a 
significantly larger adjusted mean than did either the iiCSS-ONLY or control 
croups. DMS group means were 113.5 (males) and 117.3 (females), compared with 
101. U (males) and 108.5 (females) for ZCSS only and io6.7 Craales) and 102.9 
(females) for controls. The difference was eaual to about one-half a standard 
deviation and was significant at the .01 levfil, as indicated in Table 26. 

Tables ?7 and 28 show similar findings for ficale B, i.e., the DMS group 
a/^ain had significantly larger ad^iusted means than did either zhe KCES-ONLY 
or control groups. DMS group adjusted means were ^^3.5 (males) and 279. U 
(females) compared with 23^.5 (males) and 250. u (females) for the rXISS-ONLY 
group and ?39.2 (males) and 25U.O (females) for controls. This difference is 
equivalent to about three-fourths of a standard deviation and is significant at 
the .01 level. There was also a significant sex difference on Scale 3 with 
females having larger adjusted means. This finding is consistent with results 
presented in an earlier section of this report. 

Residts of the analysis of Scale C are :3hown in Tables 29 and 30. There 
were no significant differences in adjusted rr.oans on Scale C either between 
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treatment groups or between male etna femle stuclentc. 

These results clearly indicate that the DMS treatment produced greater 
gains in the attitudinal dimensions of vocational maturity (Scale A and B) 
in both males and females. However, it shoulc' be emphasized strongly that 
students involved in ti:e Intensive Study Groups were not randomly assigned to 
the treatment they received. On the contrary, students were assigned to the 
DMS group because they were judged by their counselors to be more interested 
than other students in engaging in the experimental programs and because it 
was thought they would profit most from it. furthermore, the counselors by 
whom these students were chosen were themselves selected because they were 
thought to be more interested in the project and snore skilled in counseling 
techniques than their fellow counselors. Thus, these results show that for 
a carefully selected group of both students and counselors the DMS treatment 
was more effective in promoting certain attitudinal aspects of vocational 
maturity than were SCES and normal counseling services when used with average 
tenth-grade students. Whether the DMS treatment would be eaually effective 
with a randomly selected group of students is not known at this time. 
Certainty of Vocational Preferences . The posttest form of the GDI included 
two items intended to collect information about the degree of certainty the 
student felt about his current and past vocational preferences. These items 
were: 

92. R fght now , how certain are you about the kind of work you will be 

{.oing when you have finished your schooling? 
9^. Last year at this time, how certain were you about the kind of work 

you want to ilo when you finirh your schooling? 
The students in the Dr4S, SCEo-ONLY, and control groups v;ere compared on their 
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responses to these two ite:ns. The results of these comparisons are presented 
in Tables 31 and 3^. 

Table 31 shows the distribution of responses when the students were asked 
to report retrospectively on their certainty of vocational choice "last year at 
this time/* The DMS group appeared to be somewhat less certain than either the 
ECES-ONLY or control groups, but the difference was not significant. Alien asked 
to report on certainty of choice "right now," the dVS group appeared much more 
certain than either the ECSS-ONLY or control groups, as seen in Table 32. Forty- 
two per cent of the DMS group said they were "very certain", compared with ?3^ 
for SCES-ONIY and 12-^, for controls. Only 20i of the DMS group said they were 
"very uncertain" or "somewhat uncertain"; the figures were for ECES-ONLY 
and hCff^ for controls. Thus one might conclude that, in terms of increasing 
certainty of choice, the DMS treatment was most effective and the SCES-ONLY 
treatment was somewhat more effective than the usual guidance services received 
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by control students. 
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Implementation . Having a vocational preference is one thing; acting upon it 

is something else. Acts which represent the students' attempts to explore the 

meaning and consequences of their tentative preferences are referred to as 

acts of implementation. The extent to which a tenth grader can take steps to 

implement a vocational preference is, of course, limited. Nevertheless certain 

exploratory steps are available to him. In an attempt to assess the extent o^ 

this implementation behavior the three groups were compared on their responses 

to the following five items, include,! with the GDI posttest. 

9^». Right now I am taking the kind of Mfr,h school courses which will hel^^ 
me in collof/,e, in .job training, or on the job. 



5. This difference between DMS and SCES-ONLY participants in terms of level and 
change in certainty of career plans was confirmed by rhe posttest Student ; 
^ Questionnaire results, as described on page 50. 
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95 • ^ Right now I am taking part in school activities, or out-of -school 

activities, which will help me in college, in training, or on the job. 

Right now I am working in a job which will help me get the kind of job 
or training I want in the future • 

97* This svunmer I will be working in a job which will be related to the 
kind of work or training I want for the future. 

98. Recently I have been talking about rny interests to someone who works 
in an occupation I am considering. 

DMS, ECSS-ONLY, and control groups were compared on their yes-no responses to 

these items by chi-square analyses. The groups did not dixrer significantly in 

their responses to any of these items. 

School -Related Behavior . Though there is no particularly persuasive reason to 
suspect that either of the treatments represented by the DMS and the BCES-ONLY 
conditions would be associated with changes in certain in-school behaviors, the 
availability of the data made it possible to compare the three groups on grade- 
point average (i.e., the change from ninth grade GPA to tenth grade GPA), number 
of days absent from school, and dropout rate. 

Ninth grade CPA's were obtained for students in the DMS, ECES-ONLY and 
control groups. In addition, CPA's at the end of the third marking period of 
the tenth grade were obtained. Table 33 shows the means for the three groups 
at both periods of time. It is clear from these data that the mean CPA's from 
the three groups did not change, obviating fxirther curiosity about differential 
effects of the treatments on students* grade-getting behavior. 

Data were also collected on all members of the study who dropped from 
school during the 1971-72 school year. Only two of the i63 students for irtiom 
these data were available had dropped from school. One was in the ECES-ONLY 
group and one in the control group. With so few drop-outs, obviously no analysis 
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was feasible or necessary. 

Differences among the groups were observed when days absent from school 
were studied. Students in all three treatment groups were classified as low 
(0-5 days absent) or high (6 or more days absent). Table 35 shows that control 
group students had a significantly higher absentee rate than did either DMS 
or ECES-ONLY students. Seventy-one percent of the control group students were 
absent six or more days, compared with only Uh^ for DMS and 36^ for EC3S-0NLY 
groups. Wiiile the figures in Table SU clearly indicate a meaningful difference 
bet;^en the groups, it is not clear that the difference should be attributed 
to treatment effects. If reduction in absentee rate is one of the effects of 
the DMS and SCSS-ONLY treatments, it should be verified through replication 
studie:; designed to clarify the rationale for such an effect. 

Attitudes Toward SCS3 

Another relevant sowce of data concerning the outcomes of the demonstration 
project are the attitudes of the participants toward the activities involved. 
For example. What did the students themselves think about the value of using 
the i?CES terminal or attending the DMS sessions? Did the parents get involved? 
Wliat were their attitudes as influenced by coramehts made by their children who 
were participants? How did the counselors feel about the activities involved? 
Did they see SCES and DMS as helpful to them, as contributing to their students* 
vocational development, or was it looked upon unfavorably as an interference 
with on-going guidance activities? 

In order to obtain relevant information on the attitudes of the students 
and their parents, the names and home addresses of the students who were in the 
ECES-ONIiY and the DMS groups were obtained from the counselors. Questionnaires 
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/;ero mailed to t.he parent during J\me and early July, with three follow*up 
remindors, one v/eek apart, to non-re sponders. 

There was i;ome difficulty in getting ccniplete lists and accurate home 
addresses. At the time of the writ'lng of this report, questionftaiires had 
been mailed to lU? of the ECSS-cr«iV students and to 103 of the WS students • 
Usable results were obtained from of the 3CSS-0NLY subjects and 63 of 
the DMS subjecti:. Data were used only when there were usable questionnaire 
results from both student and parent, although questionnaires were used even 
thouf^h the respondent failed to fill in all the blanks. 

At the timf: of this writing, the questionnaires are still coming in, 
particularly in response to follow-up reminders. The following analysis is 
therefore based upon only incomplete data and the complete analysis will appear 
in the supplementary appendix which will be prepared later. However, ther^: are 
sufficient results currently available to form a reasonably confident opinion 
as to the attitudes of the participants. 

Attitudes of the Students . The Student Questionnaire (see Table 35) included 
22 questions involving estimates of the help received, kinds of Career explorat 
engaged in, over -all evaluation of the system, etc. From the responses given, 
the following questions concerning the students* attitudes can be explored: 

1. How helpful were the basic components of the programs to the students 
jn their career planning ? 

To try to Identify the effects of the various components of the rrogram, 
the respondents were asked to rate the amount of help they had received in -.h-' 
various aspects of career planning from the various 6omponents of the nj^cr.rat' 
which they had been exposed to depending upon whether they were in the -'ICES- 
ONI,Y or the DMS experimental groups. (Questions h through 15 of the Student 



Ouosiionnairo providou infor:.»a'.ion conc-^rning this ouesticn. 

One auick way df interprGtin.-^ t:io data is to examine the c^r cer4t cf the 
re:-:pondent r^roups v!ic :zava raz\v.r.^ of either ^ or (i.e. a "considerable 
amount" or a "gre8.t deal'' of help) tc caestionn through 15. Table 35 presents 
these restilts. From an analysis of theno detailed tabulations, the followixag 
generalizations can be reported. 

In both the ECBS-CXIY and the DM3 groups, SCE3 tenninal visits received 
higher ratings than dia couiiseior conferences, 'ror example, the responses to 
question 5 revealed ttiat a.'nong the SCEoOIFLY students, hhd^ found SCB3 terminal 
visits helpful in occupationar- planriin^: and 2^^^ of the students found individual, 
conferences helpful. Amon^ the DMS group, 70^1 fou*;d 3CS3 terminal visits helpful, 
59% found counselor conferences heli-i'iJ., and 39^- found DI^ group sessions helpful. 

This pattern of rating was rather consistent throu3hcut all of the ouesticns 
h through 15, i.e., the ECES terninal visits were found most helpful and the DMS 
p;roup sessions lea3t. ?:o^-ove>r5 tho DMc> ::tudent5 as a ^^oup .^ave hif;her ratinr:s 
of help fullness in practically all of the aspects of career planning. This surjg^'^t 
that although the DMS group sessions in therrselves were not rated as highly as 
the terminal visits or imiividuai counselor conferences, they probably served a 
facilitating function ani madi the terminal visits and the counselor conf'^rences 
more effective. This obviously i.^ an inference but a rather clear one, based on 
the consistency of the data. 

Another interesting- observation can be ntade by identifying the specific kinu.*: 
of help which received the hif^rest ratin<^s for each of the components, vrr-en this 
was done, it was apparent tiiat, for the SC2S-CMLY C^oup, ECSS terminal visits vrere 
particiil£u:3,y helpful in tiio:-:e aspi^c^:-? of career planning; having to do with occur;a- 
tional planning and decision-making (questions 5> 9, 11, and 13) whereas 
the counselor conferences were regaraed as most helpful in educational 
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planning and decision-making (questions 12, lU). This pattern was also appar- 
ent in the DMS group but not as clear cut. 

What effect did participation in the project have on interactions with 
parents and counselors and on the career planning activities ? 
Questions 16 to 21 in the Questionnaire deal with a miscellany of outcomes 
of participation, which can be considered to represent various kinds of career 
planning activities. From Table 35 it is apparent that the DMS group were more 
active than the ECSS-OriLY group, particularly in being stimulated to talk ;^ith 
their counselors and with their parents about their experiences with the system 
and in exploring new occupations and possible ma;}ors. For example, 63iy of the 
DMS group reporting exploring four or more new occupations that they had not 
previously known about (question l6) whereas only 26^ of the SCSS-OTtTLY group 
reported likewise. Almost 86<?^ of the DMS group reported t Sieving that because 
of using SCSS they would profit moro from talks with their counselor (question 
18) whereas 6hi of the SCiS-ONLY group reported likewise. Almost 63% of the 
DMS group reported that they discussed ECSS with their parents three or more 
times whereas only UOi of the SCBS-ONLY group so reported. 

The above observation should not minimize the fact that even the SCSS-ONLY 
group were stimulated to engage in a considerable amount of career planning 
activity and considerable exploration of facts about themselves or the world of 
education and work through exposure to the system. It demonstrates, however, 
rather clearly- that supplementing SCES terminal visits with organi'^ed DMS group 
sessions does stimulate or facili^att.' the hoped-for outcomes of the BCES system 
itself. 

Did the groups differ as to definiteness of future -areer plans ? 
Questions 2 and 3 of the Students* Questionnaire yielded data on this 
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question. From Table 35 it can be seen that both the ECES and the DMS groups 
repoi-t.ed becoming more definite about their future plans during the period 
between the end of the ninth grade and the tenth grade. This was particularly 
true in the case of the DMS students. 

The ECES-ONLY students reported that at the end of the ninth grade only 
about 2Qri were rather definite or very definite about their future plans while 
at the end of the tenth grade of the ECES-ONLY group reported this dgree 
of def initeness. In the case of the DMS students, only l6fo reported definiteness 
at the 6 of the ninth grade with at the end of the tenth grade. If we 
look at th- U6 :5CHS-CNLY students who reported ninth-grade uncertainty (responses 
i or 2 or 3 on the questionnaire) we find that 19 of them {hioj,) reported definite- 
ness (responses U or 5) at the end of the tenth grade. Similarly of the 52 
DMS students who reported uncertainty at the end of the ninth grade, 31 (60;^) 
had moved to the definite categories by the end of the tenth grade. Only a 
few individual subjects reported being less certain now than in the previous 
year and 60^- of the BCES-OIILY and 15% of the DMS students reported being more 
certain now (question 2) than at the end of the ninth grade (question 3). 

It must be recongnized, of course, that not all of this change can be 
attributed to participation in the KCES demonstration project. We did not get 
questionnaire data from the students in the control group so at this point we 
do not know how much of this change can be attributed to merely the passage of 
time or to the regular guidance program activities and how much to SCES. 

What was th e students' attitude towards the value of ECES as a whole , 

including termi nal visits and counselor conferences in the ECES-ONLY group 

and terminal visits, counse lor conferences, and the DMS group sessions in 

the DMS group? 
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Analysis of the responses to question 22 reveals quite clearly that both 
the SCSS-OKLY and the DMS groups had positive attitudes toward their experiences. 
Only H of the DM3 respondents reported that their experience was of little 
value in career planning and 15^. of the EKSS-ONLY group so reported. Of the 
DMS group, nio rated the experience as of considerable or of great value in 
planning and h2i of the SCSS-ONLY group gave similar responses. 

In summary, the responses of the students on the Student Questionnaires 
filled out at the conclusion of their tenth grade SCE3 experience provide, 
encouraging evidence of the positive feelings of the students toward that 
experience. In general they found participation in the 3CES project to Se" of 
considerable value, they moved along in the definiteness of their career plains, 
they engaged in career planning activities and in interactions with coimselors 
and parents, and they found the terminal visits and the DMS grov p sessions of 
considerable help in occupational planning and in stimulating interactions with 
their counselors on educational and occupational planning. 

Attitudes of Parents. Analysis of the questionnaires from the 65 parents of the 
SCE3-ONLY subjects and from the 63 parents of the DM3 subjects yielded results 
which were congruent with those of their students in terms of generally favor- 
able attitude toward SCES. In the case of the Parent Questionnaires, the inter- 
est was primarily in finding out whether they thought that their children had 
received benefits from participation and also whether or not the experience had 
led to significant interaction between the parent and the child concerning the 
student's career development. In the original development of the system, it 
was hoped that the system would lead to more interaction between students and 
their parents about career planning and that the parents would become more 
directly involved. 



Questions 1, and 3 of the Parent Ouestionnaire deal with the question 
of parental involvement. The results of Question 3 (see Table 36) showed that 
65f) of the DMS parents reported that they become more involved in their 
childrens' educational or vocational planning and ^^3^ of the BCES students' 
parents so reported. 

Question 1 revealed that in the case of both groups the students had 
discussed with their parents various aspects of the SCES experience, h,k% of 
th(3 DMS parents reporting regular or quite a lot of discussion and 22<, of the 
•CC-CS-ONLY reported this amount of discussion. Only 3<^o of the DMS parents 
reported that their children had not discussed it at all and iH of the SCES- 
ONLY students so reported. It may be that in the case of the RCES-CNLY, these 
were the students v7ho had had little or no real exposure to the program although 
they were technically in the rXES experimental group. 

Analysis of Question 2 responses showed that the activities most frequently 
discussed by students and their parents included terminal visits, counselor 
conferences and reading about occupations. Reading about what schools to go to 
after high school was less engaged in by both groups. This may be because, as 
tenth graders, they thought that this problem could be postponed until at least 
the following year. As in the case of the student responses, there appearerl to 
be less interaction between students and their parents concerning the DMS ses- 
sions, since only about 50/^ of the DMS students reported discussing thf^m vdth 
their parents on all aspects of the ECES program, thereby reinforcing the 
observation made above that the group decision-making sessions raised the level 
of activity of career planning in general as compared with the ECSS-OWLY program. 

Question 6 dealt with kinds of activities engaged in by the parents with 
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respect to their childrens ' career planning. Again we find that the DMS 
parents were more active than the MCES-ONLY parents, although neither parent 
group reported much in the way of meeting with the school guidance counselor 
or in obtaining private counseling for their children. Greatest activity was 
found in encouraging their children to talk with individuals already employed 
in careers being considered or in obtaining occupational information to assist 
their children to decide on future plans. Approximately one quarter of the 
parents in both groups reported helping their children find sunmer employment 
related to career goals. Over half of the DMS parents reported making sure 
that their son or daughter was meeting the counselor whereas only about a 
third of the ECSS-OraY parents so reported. Again one can make no compari- 
sons with a control group of parents whose children were in neither BCES nor 
DMS, so it cannot be reported that this amount of parental activity was 
relatively high or low. However, it appears to be more than the usual parental 
involvement as experienced in most school situation. 

Question k dealt with the amount of help which the parent felt that their 
children were receiving from ECES, help in such career planning aspects as 
seeing connections between school experiences and future plans, getting use- 
ful facts about the world of work, seeing connections between interests and 
abilities and occupations, etc. Here the^^esults were ouite encouraging, par- 
ticularly in the case of the DMS parents. For example, Jhi of the DMS parents 
reported that their children received a great amount of help in seeing connec- 
tions between their childrens' interests and possible occupations and 6^ on 
connections between abilities and occupations. The comparable percentages in 
the SCES-ONLY group were he and hO^, respectively. In general, the DMS parents 
gave higher estimates than did the ECES-ONLY parents, but the relative esti- 
mates among the seven activities listed in the questionnaire were remarkably 
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similar. It appea^^s that exposure to the KCES system in general resulted, 
at least as perceived by the parents, in their children learning about the 
relationships between personal characteristics and occupational possibilities, 
getting useful facts about the world of work, and discovering new educational 
and occupational opportunities to look into. The lowest estimates, although 
still significantly high, were in seeing connections between high school 
experience and future plans and in making good decisions about what to do 
after high school. This confirms the finding on the student questionnaires 
that the system had greater impact on occupational planning than on educa- 
tional planning. 

Finally, Ouestion 5 asked the parents whether they tho'oght their son or 
daughter would be better able to make decisions about careers as a result of 
participating in the ECES program. The overall evaluation yielded highly 
positive results, with 8l^. of the DMS parents and 5% of the SCES-ONLY parents 
checking the positive end of the four point scale. 

In smmnary, it can be rather confidently concluded (l) that the parents 
of both groups had a generally positive attitude toward the SCES program, (2) 
that the participation in DMS group sessions facilitated and increased zhe 
effects of exposure to SCES, particularly in terms of understanding of oneself 
in relation to occupational possibilities, and (3) that it resulted in increased 
interaction between parents and children concerning positive st«ps which their 
children should be taking in looking forward to their post high school careers. 
Attitudes of the School Counselors . The third group in the "consumer attitude" 
evaluation of the ECSS program consisted of the counselors in the schools where 

the experimental groups were located. In order to probe as intensively as ' 
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possible the attitudes of this significant group, a combination of Questionnaire 
and interview was used. The Counselor Reaction Questionnaire (see Appendix) 
was a brief one consisting of l8 statements about which the counselors were 
aske(i to express an opinion. The counselors filled them out individually as 
part of an individual interview session and immediately upon completing the 
questionnaire, the interviewer questioned the respondent concerning some of the 
questions and also asked some open-ended over-all evaluation questions. 

It is somewhat difficult to draw firm conclusions from the counselor 
da^a since the counselors were not assigned at random to the experimental 
groups nor had they had comparable orientation to the programs. In addition, 
even though the interviews were held late in the semester, the counselors' 
students were at different stages in their exposure to BCSS. In fact, some 
of the ECES-ONLY students had not yet been on the terminals at all. It should 
also be kept in mind that a given counselor had many more students than those 
participating in the program and that they had to respond to the questionnaire 
only in terms of their recollections of those students under their guidance 
who were members of an experimental group. However, a given counselor had 
students either from the DMS or the BCES-ONLY experimental group but not both. 
Detailed data will be given concerning the questionnaire and interview responses 
in a later supplementary report. However, at this point, the following 
observations or interpi-etations of responses can be made: 

1. The DMS counselors were more involved in the program than were the 
ECES-ONLY counselors, both in terms of time spent and in identification with 
the program. For example, all 13 of the DMS counselors interviewed reported 
that they felt that they were an important participant in the ECES field trial 



whereas only h of the 11 ECSS-ONLY counselors made a similar response. These 
attitudes were confirmed by the kinds of observations made by the DI^S counselors 
in discussing their role. 

2. A]l of the counselors, both DJ^S and 3CES-0NLY, agreea that the ECES 
system was useful and that it stimulated the students to learn about themselves. 
However, some of the ECES-ONLY counselors agreed that terminal exposure alone 
may create student uncertainties which need resolution by group or individual 
sessions. It may be recalled from the data from the student and parent Ques- 
tionnaires that DM3 participation did stimulate more group and individual 
counselor sessions and threrfore it may be inferred that these uncertainties 
would have more probability of being resolved. From a learning point of view, 
one also might argue that learning occurs best when there is some challenge to 
one's current status and that uncertainty without anxiety is probably beneficial. 

3. Both groups of counselors agreed that ECES was useful at all grade 
levels 9 throu(.;h 12, although there was less agreement as to its use in the 
ninth grade. 

U. Some of the counselors reported that ECES alone is difficult for some 
students, particularly in following the decision-roaking strategies and in using 
the charts without counselor help. 

5. There was common agreement, within both groups of counselors, that the 
students enjoyed the terminal experiences, whether alone or in combination with 
the DMS group sessions. There was agreement among the DMS counselors that the 
students found the ;-roup sessions useful but several observed that it was easy 
for the sossionr. to beromo too much like a regular school subject and for the 
assignments to be looked upon as chores or as repetitious rather than challenging. 
In fact, some counselors reported a gradual deciline in use of the assignments 
and at 3.east one counselor used part of the group sessions for what amounted to 
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supervised study rather than having th. assignments done cutsido. 

There were differences between the SCSS-OKLY and the DMi5 counselors 
as to the nature of their involve>nent. Particularly in the case of the ECES-ONLY 
counselors, some of the counselors were not clear as to what their role was to 
be. So..,e had not yet seen their subjects and .ome had had then^. assigned only 
recently. Some of the. had had inadeauate orientation. This v.s in contrast to 
the DM3 counselors who had received better orientation and felt .ore involved. 

7. One question dealt with the effect the presence of the SCES-ONLY and 
the DMS program had upon the counselors' total work load. The DMS counselors' 
involvement required extra work which made it more difficult for them to meet 
the total students needs. For example, seven of the DMS counselors agreed that 
"ECES/DMS has caused to see types of students I did not previously see." 
It is interesting, however, that nearly all of both groups of counselors inter- 
viewed agreed that "the extra work created by SCES/DMS is justified by the 
effects on the students" and most of the counselors agreed that their "work with 
students was at a much higher level because of ECES/DMS." 

8. One major concern of the counselors, those with generally positive 
attitudes toward ECES as well as those less positive, was about how the system 
could be made operational on a regular basis. They agreed that it would not be 
feasible just to add ECES and DMS group sessions on top of everything else and 
still expect counselors to maintain the caseloads which they now have or to 
remain as involved in routine administrative activities or to continue being 
given responsibilities for "non-guidanoe" programs such as now are frequently 
assigned to counselors. The most positive attitudes appeared to be from those 
counselors who were a),le to reor,anizc their work situation in order to devote 
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a considerable time to the experimental c^oup. They tended to find it exciting. 
Those for whom this was merely an addition to their load were obviously less 
involved and usually less positive. Several of the counselors had practical 
suggestions as to how the DMS sessions and SCES terminal supervision cooLd 
be carried without increasing their load and as to how to make their sessions 
with the students more valuable. 

In summary, it is fair to conclude that the counselors involved took a 
basically positive attitude toward the value of the availability of ECES terminal 
visits for their students and also for the group sessions designed to improve 
the decision-making ability of their students. Exposure to the system was re- 
garded as valuable, particularly in the tenth and eleventh ,'^rades. The chief 
problem appeared to be in integrating the system into the total guidance program 
in ways which would take advantage of its usefulness and yet be feasible in terras 
of counselor work -load and total responsibilities. The responses clearly indi- 
cated that when the students and the counselors were really involved, both in 
tirae and in interest, the belief was that the program made substantial contri- 
butions to tne career development of the student participants. 
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V. SU^WARY AND CONCLUSIONS 



The computer-based Educational and Career S>cploration System (SCES), 
developed at the Advanced Systems Develpment Division of the International 
Business Machine Corporation, has been subjected to two and one-half academic 
years of field trials. The first trial took place In Montclair, New Jersey 
High School during the Spring term of I969. A sample of I60 students used SCSS 
during the trial. The following findings resulted: 

a. ECES could be installed and maintained in a secondary school. 

b. ECES was appropriate for both male and female high school students of 
all grades, for both black and white students, and for the college -bound 
as well as non -college -bound. 

c. During the brief trial, little measurable effect on the vocational 
maturity of the students was observ(*d. 

d. The students, their parents, and the counselors were highly positive 
in their reactions to ECFS. 

Following the Montclair trial, ECES was extensively revised and adapted 
for a second trial to be carried out in Genesee County, Michigan. During the 
1970-71 academic year, ECES was used by approximately 3,000 tenth-grade students 
from 13 experimental high schools in Genesee County. The students were compared, 
before and after using ECES, with an approximately equal number of students from 
control high schools matched to the experimental schools. From the 1970-71 
field trial, the following conclusions seemed justified: 

a. The Career Development Inventory (CDl), constructed for the field 
trial, provided a reliable measure of vocational maturity. 

b. The restrictions on the students' use o^' durinfc the trial limited 



the definitiveness of the findings. Less than H of the students had 
the opportunity to use ECES for as many as four ho^rs, in contrast to 
the mean of 6.7 hours for Montclair tenth-graders in the 1969-70 
study. 

c. The reactions of the students to 3CSS were overwhelmingly favorable. 

d. Students who used KCES showed improvement slightly greater than non- 
users in terms of the quality of potential occupational resources 
they knew about and the quality of the occupational resources they 
actually used. Other aspects of vocational maturity, such as planning 
orientation, Quality of decision making, and information possessed, 
were not affected. 

e. The counselors approved of ^CES when asked to consider its effects 
on students and when asked to consider the specifics of the system. 

Summary; The 1971-72 Field Trial 
Having benefited from two previous trials, the plans for the second year 
of the Genesee County trial werj more carefully made. To begin with, the 
computer terminals with which the student used ECES were removed from a central 
location and placed in the schools the student users were attending. Secondly, 
care was taken to insure that some students used ECES for more hours than had 
been the caso during the previous year. The CDI vas improved and used again, 
and the carefully matched and randomly designated experimental and control 
schools were once again employed. Finally, a demonstration project wj.s conducted 
to assess ECES usefulness under the best of available conditions. 

Results: Vocational Maturity . Most tenth-graders in both the experimental 
and control schools were given the CDI at the beginning of the academic year; 



more than 10,000 students were tested. Near the end of the school year, after 
students at the experimental schools had used ECSS, a posttest was attempted in 
both experimental and control schools. The posttest yielded ?2U5 usable tests, 
792 frora students who had used SCES. Analyses of covariance led to the findings 
listed below: 

a. ECES users showed larger gains than non-users both in degree of 
planning orientation (CDI, Scale A) and in choice and use of resources 
for exploration (CDI, Scale 3). 

b. Users did not differ from non-users in quality of decision making and 
amount of (occupational career) information possessed (CDI, Scale C). 

c. There was a significant positive relationship between the amount of 
time a student used SCSS and the amo^ont of pre- to posttest gain on 
CDI Scales A and B. 

d. Although the differences described above were highly significant from 
a statistical point * view, they were small in absolute terms. 

A separate analysis was attempted to assess possible delayed effects- of 
using ECES during the tenth grade on selected eleventh -grade students. No 
delayed effects were observed. 

Results: Demonstration Rroject . Recognizing that attempting to involve 
nearly 120 counselors from 26 high schools in the field trial would lea^l to 
irregularities of control and treatment conditions, a demonstration project v*as 
designed in order to provide a trial for ECES under the best available conditions. 
The demonstration project included three conditions: (l) group sessions involvinf^ 
the Decision Making Syllabus (DMS); (2) terminal time on ECSS without specially 
structured supporting counselor activity (>:C2S-0?JLY) ; and (^0 a control condition 



involvirifr neither DKiS or 2CSS-0NLY. 

Fourteen coimse3.ors were selected for each of the three conditions and 
each counselor was asked to select 15 students to comprise his group. The 
counselors selected for the DMS condition were especially chosen for their 
interpersonal skills auid enthusiasm for 3CES, No such criteria were applied 
in selecting the counselors for the other two conditions • The SCES-ONLY coun- 
selors carried on guidance services as usual at experimental schools • The 
control counselors did the same at control schools • 

DMS counselors conducted a specially tailored, educational program for 
teaching decision-making skills. The Df^ program had as its goals: 

a, to provide counselors with a systematic program to facilitate and 
direct their efforts to develop career decision-making skills in 
students; 

to provide the counselors with a systematic program to maximize the 
students* exploration and utilization of SCSS within the context of 
his career decision-making skill acquisition; and 
c» to provide the student v;ith a systematic program that increased the 
quantity of career decision-maJcing skills he needs to make more sys- 
tematic and logical career decisions. 
The DMS condition incl\ided ten classroom sessions, three personal visits 
with the counselor, and four hours of ECES use. To assess its effects, a Career 
Decision Making Skills test was especially constructed and administered before 
and after the student experienced the DMS. SCES-^NLY and control students were 
also tested for comparison. 

The comparisons led to the following tentative findin^^s^ 
a» The DMS group gained significantly more than the :Crr>-OTIIiY and the 
control groups in career (Iccision-makinp: skills an/? in planni:u>: 
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attitudes and insights, as measured by the Career Decision Making 
Skills test. 

b. GDI scores for the three groups, when submitted to an analysis of 
covariance, indicated that the DMS treatment produced greater gains 
in attitudinal dimensions of vocational maturity (Scales A and B), 
but not in decision making and information (Scale C). 

c. The DMS group appeared to be much more certain of their career futures . 
than either the SCSS-ONLY or control groups. 

d. The DMS and SC3S-0NLY groups did not differ in the extent to vhich 
they had taken :teps to implement their present career plans. 

e. none of the special conditions influenced students' grade -point 
averages, 

f. Control group students had a significantly higher school attendance 
absentee rate than either DyJ2 or SCES-OTfLY students. 

g. All students reported enthusiasm for 3C3S and estimated that they were 
helped by it in planning their futures. DMS students were, in general, 
more positive than SCSS-ONLY students, but both were highly positive. 

h. Parents of both DMS and SCSS-ONLY students had generally positive 
attitudes tov/ard their children's experiences. Participation in the 
DMS clearly facilitated and increased the effects of the exposure to 
SCES. Both Dr^tS and SCBS-ONLY treatments resulted in increased inter- 
action between parents and children concerning the children's futures. 
The DMS effects were the more powerful. 

The counselors involved in both the DMS and the D?« and the BCES-0!n,Y 
conditions took a basically positive attitude toward the value of the experiences. 
They regarded the experiences as valuable, especially for tenth and eleventh 
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graders. The more extensive and time-consuming nature of the DMS led to 
oo^onselor reservations about integrating such a program into the total guidance 
program. However, there was wide agreement that the values of the DMS procedure 
justified the struggle with the feasibility problem. 

Conclusions 

In arriving at conclusions about the 1971-72 field trial, and those that 
preceded it, it is te.nipting to react to the events and findings described herein 
vith the rigor and caution one usually applies to research procedures and evi- 
dence. Yet, as we have tried to portray throughout the report, this effort 
was a field trial and not, in the strictest sense, a research effort. In the 
design of data collection efforts we have attempted to infuse rigor where 
possible and to control for biases that woul-! lead the reaci^r astray. Our 
success at doing so has been only partial. 

But rigorous or biased, a great deal of data have been collected, analyzed 
and reported. While the normal operations of 26 high schools in Genesee County 
proceeded, an enormous educat onal innovation was incorporated. As with any 
field trial, some routines were disrupted and some people v;ere inconvenienced. 
As with any field trial, the elegance of instrumentation and data collection 
fell short of fondest hopes but by f<ir exceeded worst fears. As with any field 
trial, plans were changed as they were being implemented, bat , unforeseen 
necessities and unpredicted resistance did not invalidate the enterprise. 

The conclusions offered below are necessarily tentative. They are, 
however, the result of the assessment team's best Judgments about the efficacy 
of 3CS3 and its use. 
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1. The students who use ECES en,-^oy using it, find It easy to use^ and 
feel that they benefit from it > This conclusion is offered with confidence 
based on almost totally supporting evidence from Montclair, from Genesee County 
in 1970-71, and again in Genesee County in 1971-72. The evaluation team 
recommends that no further concern be devoted to th-is issue. 

2. The parents of students vho use SCES are pleased vith it, want it to 
be available to the children, and-most important^ become more involved in t he 
planning efforts of their children . This too is a repeated finding and one 
deserving of confidence. Clearly, more intensive study of how parents become 
involved and how long that involvement persists wo\ild be of some value. Never- 
theless, parents* acceptance of the innovation has been established. 

3- Counselors in schools where SCSS is available to students value it 
highly, estimate that It has a positive effect on students and think it ought 
to be available to more students . To their credit, counselors are not totally 
uncritical of the innovation. They have formed many useful suggestions for 
the revision of 2CES and for its use in the schools. They have recognized that 
such a system does call for changes in their professional functioning. By and 
large, they are accepting of these changes. 

Students who use ECES show small but clearly real gains in two important 
aspects of vocational maturity: planning orientation and choice and use of 
resources for exploration. ECES alone does not lead to gains in decision . baking 
or occupational information possessed . The evaluation team is less confident of 
this conclusion than of those that precede it. To begin with, it is strongly 
suspected that the conditions of the field trial never resulted in ECES being 
used for a sufficient amount of time (see conclusion 5) by large number.*^ of 
students. Secondly, it must be born in mind that the instrument used to measure 
vocational maturity, the CDI, is still in an experimental form and may lack 
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precision. All of that not withstanding, irrefutable evidence of small gains in 

attitudinal aspee+,s of vocational maturity has been presented. That such 
evidence resulted despite data collection problems of major proportions is 
extremely encouraging. 

5. The more ti me a student uses SCES, the more gain the student shows in 
planning orientation and choice of resoiirces for exploration . This conclusion 
is drawn confidently on the basis of the data collected, but it does have 
limits as a generali-.ation. The data suggest that there may be an optimal use 
time beyond which corresponding gains may not be expected. Students who used 
SCES for from five to seven hours showed gains that were meaningfully larf^er 
than those using ECES for from two-to-four hours. Those who used ECE3 for 
more than seven hours did not show correspondingly larger gains. However, 
from these data it is not possible to identify an optimal use time with 
confidence . 

When combined with a carefully planned program for developing decision- 
making ski lls, the use of ECS3 contributes to meaningful gains in planning 
orientation, choice o f resources for exploration, and in the decision making 
skills. The data to support this conclusion are those from the demonstration 
project. They demonstrate that when ECES was accompanied by a systematic 
training program, mediated by carefully chosen counselors, for the benefit selected 
students, the gains for those students were superior to those of students who 
used ECSS alone. 

The suggestion from these findings seems hardly debatable: who the coiui- 
selor is and what he does matters with respect to the effects of 3CES. If only 
BCES is made available to students and counselors, a variety of use strategies 
and highly variable effects on students will result. If, however, SCEo is 
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supplemented by careful attention to the human resources which support it, i.e. 
a systematic plan for counselor activity, the original goals of 5CES development 
will more likely be realized. 

Finally, it seems appropriate to suggest that the efficiency of ECES and 
its use need not be subjected to fu.»-ther studies of the large-scale field trial 
variety'-. The general facts that (l) it can be comfortably added to a high 
school guidance program, (2) students will use it with enthusiasm, and (3) with 
appropriate counselor-mediated conditions students will benefit from that use, 
seem well established. Further investigations, therefore, ought to begin with 
these facts as assumptions etnd focus on -nore carefully controlled approaches to 
educationally relevant issues. 
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Table 1 

CDI (Scale A) Pretest, Posttest, and Adjusted Means and Standard Deviations 

For Tenth-Grade User and Control Groups, by Sex. 

Treatment 

Group 



Controls 



Totals 



Sex 


Number 


Pretest 
Mean Stnd. Dev. 


Posttest 
Mean Stnd. Dev. 


Adjusted 
Mean 


Mai 2 


376 


95.3 


19.6 


103.2 


22.2 




Female 


ki3 


'95.2 


20.8 


idk.6 


22.0 


105.9 


Male 


718 


99.0 


19.6 


103.9 


20.1 


102.6 


Female 


736 


97.3 


20.3 


103.'+ 


21.2 


103.2 




22^7 


97.1 


20.1 


103.7 


21.2 





Table 2 

Two-way Analysis of Covariance of CDI (Scale A) Pre-and Pofttest Scores 

For Tenth-Grade User vs. Control Groups, by Sex 



Source of Variation ^ra of 
.oares 

Treatment 2601.6 

Sex 588.5 

Interaction 90.I 

Mean 13^^23^.5 

Covariates U1U102.8 

Error 59^^3^6.9 



Degrees of 
Freedom 



22 



* Significant at the .01 level (p^ .01) 



Mean 
Square 



2601.6 9.8* 

588.5 2.2 

90.1 0.3 

13^23U.U 506M 

U1U102.8 1562.1^ 
265.1 



Table 3 



GDI (Scale 3) Pretest, Posttest, and Adjusted Means and Standard Deviations 
For Tenth-Grade User and Control Groups, by Sex 



Treatment 



Pretest 



Posttest 



Group 


Sex 


Number 


Mean 


Stnd. Dev. 


Mean 


Stnd. Dev. 


ECES Users 


Male 


376 


230.6 


kh.2 


239.9 


52.6 




Female 


415 


239.0 


kS.k 


255.0 


k8.2 


Controls 


Male 


718 


236.3 


h9.5 


239.^ 


50.9 




Female 


738 


2lil.O 


k9.6 


2k9.2 


k9.k 


Totals 




22k7 


237. 1+ 


k8.6 


2I15.6 


50.6 



Adjusted 
Mean 

2I13.8 

23h.l 

2k0.0 

2k7.2 



Table k 

Two-way Analysis of Covariance of GDI (Scale B) Pre- and Posttest Scores 
For Tenth-Grade User vs. Control Groups, by Sex 



Sotirce of Variation 

Treatment 

Sex 

Interaction 
Mean 

Covariates 
Error 



Sum of Squares 
li+637.8 
39327.6 

1287.9 
1137018.3 

1677797.9 
3988222.9 



Degrees of Freedom 
1 
1 
1 
1 
1 

22l|2 



M°a I Square F 



lJ+637.8 8.2* 

39327.6 22.1* 

1287.9 0.7 

1137018.0 639.2* 

1677797.9 9^3.2* 

1778.9 



* Significant at the .01 level (p^.Ol) 



7h 

TwVole 5 

GDI (Scale C) Pretest, Posttest, and Adjust'wd Means and Standard Deviations 
For Tenth-Grade User and Control Groups, by Sex 

Treatment Pretest Posttest Adjiisted 



Group 


Sex Niuaber 


Mean 


Stnd. Dev. 


Mean Stnd. Dev. 


Mean 


ECES Users 


Male 376 


15.9 


5.3 




16.2 




Female ill 5 


16.6 


k,7 




17.0 


Controls 


Iviale 71S 


15.9 


5.3 




16. y 




Female 738 


17.1 






17.0 


Totals 


22k7 


le.k 


5.1 







Table 6 



Two-Way Analysis 


of Covariance 


of GDI (Scale G) Pre- 


and Posttest 


Scores 


For 


Tenth-Grade User vs. Control Groups 


, by Sex 




Source of 


Sum of 


Degrees of 


Mean 




Variation 


Sqxiares 


Freedom 


Square 


F 


Treatment 




1 




2.8 


Sex 


116.2 


1 


116.2 


5.9* 


Interaction 


53.6 


1 


53.6 


2.7 


Mean 


9187.0 


1 


9187.0 


J^69.3 


Covariates 


21232.8 


1 


21232.8 


108.7 


Error 


^+3887.7 


22^12 


19.6 




* Significant at 


the .05 level (p< .05) 







75 



Table 7 



GDI (Scale A) Tenth-Grade Means and Standard Deviations by Number of Hours 
01" ECES Use-Time 

Pretest Posttest Adjusted 



Time Sptnt on ECES 


Number 


Mean 


Stnd. Dev. 


Mean Stnd. Dev. 


Mann 


Less than One Hour 


101 


91.6 




19. u 


96.0 


22.3 


98.1 


1-2 Hours 


308 


9^.9 






101.9 


20.6 


102.1 


2-3 Hours 


176 


9i+.U 




21.3 


")2.6 


21. U 


103.0 


3 - U Hours 


87 


96.8 




18.5 


108.5 


21.6 


107.5 


U - 5 Hours 


57 


100.9 




18.5 


116.3 


23.3 


112.9 


5-6 Hours 


28 


92.3 




23.0 


105.7 


25.7 


107.5 


6-7 Ho\xrs 


13 


103.5 




21.8 


123.1 


16.1 


118.1 


More than 7 Hours 


21 


100.0 




17.3 


115.8 


18. u 


112.9 


Totals 


791 


95.2 




20.2 


103.9 


22.1 








Table 8 












one-way Analysis of Covariance of GDI (Scale A) Tenth-Grade Pre- 


and Posttest 


Scores by Number of Hours 


of ECES Use 


-Tj.me 






Source of 


Sum of 


Degrees 


of 


Mean 






Variation 


Squares 


Freedom 


square 


F 


Treatment 


IU732.2 




7 




210^+. 6 


6.8* 


Covariates 


116878.0 




1 




116878.0 


378.2 


Mean 


76539.3 




1 




76539.2 


2U7.7 


Error 


2U166I+.5 




782 


309.0 





* Significant at the .01 level (p<.Ol) 
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Table 9 

GDI (Scale B) Tenth-Grade Means and Standard Deviations by liumbex- of Hours 
of SCES Use-Time 



Time Spent on ECES Number 



Less than 1 Hotur 

1- 2 Hours 

2- 3 Hours 
3 - t Hours 
^ - 5 Hours 

5- 6 Hours 

6- 7 Hours 
More than 7 Hours 
Totals 



101 



2« 



Pretest Posttest Adjusted 

Mean Stnd. Dev, Mean Stnd. Dev. Mean 



223.U 39.3 225.1 57.2 



308 23U.O 2U5.2 U7.I 



176 237.3 53.7 2U6.5 U8.6 



•37 231.3 39.2 251.7 1}2.5 



5? 251.9 



27*^.1 52.7 



223.7 Uo.i 265.3 63.S 



13 ?60.9 57.2 290.8 U9.0 



21 255.0 U3.5 271.1 U1.2 



230. P 
2U5.7 
2U5.3 
253.5 
265.3 
270.9 
273.0 
261.3 



791 235. 



h-:>.(- 2U7.8 50.9 



■9 



1 



laole i: 



One-way Analysis of Covariance of Z31 (Scale B) Tenth-Grade Pre- ar.d Posttest 



Scores by NiLnber of Mours of ECES Use-Time 



Source of 
Variation 



Treatment 



Covariates 



Sum of 
Scuares 



De^jrees of 
Frcedor* 



Mean 
Souare 



llSC^.o 



1^003^5.2 207.5 



Mean 



i 526ScU.i- 273.1 



:irror 



i503iil3.8 



'^c2 1928.9 



^ Significant at the .05 level (p<.05) 
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Table 11 



(Scale C) Tenth-Grade Means and Standard Deviations by liumber of Hours 



of SCES Use-Tijne 



Time Scent on ECSS Kuxaber Mean Stnd* Dev 



Posttesc Adjusted 
?-?ean Stnd. Dev* Mean 



L-ess than 1 !Iour 



101 1^.2 



•i 1 



13/; 



1-2 Hours 



336 IC.2 



15*9 



2-3 Hours 



17o 1-^^ 



- h Hours 



67 



17.2 i..6 



U - 5 Hours 



57 17.6 



17. 



5 - b Hoia>-i 



26 17.5 ^-.2 



17.1 



D - 7 Hours 



13 



I-..'-. 



!iOre than 7 Hour? 



21 17.3 



17.2 



totals 



79 
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Table 12 



one-way Analysis :>f Covariance o:" C:^I (Scale C) T<.n;:h-Crade ?rc- and Posttcst 



Scores by liumber -7 ::jurs -J iC:S :jse-Tline 



Source of 
Variation 



Treatment 
Ccvariates 
Mean 
Error 



Sum of Squares 

l:ll:.3 

7590. 



Frcedon 



Voan 
Sa'iare 



110.3 



Table 13 

Sleventh-Grade GDI (Scale A) N:eans, Ad.:usted Mean?, and Standard Deviations 

For U5?er and Control Groups, by Sex 

lOth-Grade llth-Grade 
Posttest Posttest Adjuste 



Treatment Group 


Se:-: 


Nu*T.ber 


Mean 


Stnd. Dev. 


Mean 


Stnd. Dov. 


Mean 


5CSS Users 




17 


113.2 


11.7 


107.3 


1'^:.2 


105.3 




^cual.c 




112.0 




i. l<. . J- 


1- .1 


110.-; 


controls 


Male 


27 


109.9 


13.9 


102.7 


2c.- • 


102.2 








103.'.' 


20. U 


103.9 


2U.1 


111.1 


Totais 




12U 


10?.:' 


19.2 


108.3 


22.;: 





Tablo 1^* 

rwo-W;iy Anal^/sis cf Cevarlanje of Eleventh-Grade CDI (Scale A) 
For user vs. Control Groups, b./ Se:-: 

Source of Sa-n of Je.^rees of Mean 



Variation 


Squares 


Freedoa 


Square 


—1 
r 


Treatment 


U3.O 


1 


^3.3 


0.1 


Sex 


1370 0 


1 


1370.5 


3.1 


Interac^.ion 


37.5 




?7.5 




Mean 


IIS50.3 


I 


11658.3 


27.2 


Covariates 




1 


=/v-0.U 


20. U 


P3rror 


VI769.8 


119 


2^35.2 





Table 15 

Eleventh-Grade GDI (Scale B) Means, Adjusted Moans, and Standard Deviations 
For User vs. Control Groups, by Sex 



IQth -Grade 
Posttest 



11th -Grade 
Posttest 



Adjusted 



Treatment Group 


Sex 


Number 


Mean Stnd. Dev. 


Mean Stnd. Dev. 


Mean 


r!CES Users 


.*;ajLe 


J- f 


250.7 29. U 


2U7.I 


J. ; 


2h'),2 








250.0 37.5 


279.'^ 




278.2 


Controls 




27 


25C.O !;5.8 


255.3 


0 

^ • «^ 


250.3 




F Tulle 




239.^ 50.? 


256.9 


U7.1 


?-.3.-; 


T:5tais 




121: 

Table Iv 


2U7.V I13.H 








1 wQ— way i\jhxi,j i> io 




iance of Eleventh-Grade c:;! (Scale 


3) 






For U 


ser vs. 


Control Gr.ups 


, by Sex 








Soiirce of Variati 


on ^ 


Sxiia of 
Squares 


De.-Tees of 
Freedoni 


Mean 
Sauare 






Treatment 




59^.2 


I 


59^.2 


0.^, 




Sox 




lV;80.7 


1 




12. -'^ 




Interaction 






1 


255'*.1 


2.2 




Mean 




43321.2 


1 


ii3321.2 


27.2 




Covariates 




B131' .0 


1 


S13I'--.J 


9.9 




Srror 




l3fii+59.3 


119 








* p<.01 
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Table 17 

Eleventh-Grade GDI (Scale C) Means, Ad.j-;sted Means, and Standard Deviations 

For User vs. C":ntrol Groups, by Sen 

lOth-Grade llth-Grade 
Posttest Posttest Adjusted 



Treatment Group 


Sex 


Number 


Mean 


Stnd. Dev. 


Mean 


Stnd. Dev. 


Means 


ECES Users 


••iale 


17 


17.2 




lc.3 


h.i 


19.3 




Female 




19.1 




20.1 




19.^ 


'ontrols 


Male 


27 


17.1 








17.0 




FerrAle 


hh 


li.I 




P.O." 


J. ^ 




Total*: 




12U 


iD.l 




19.3 


^ • J/ 





Two-V/ay Analysis of 


Ccvariance of Eleventh-G 


xde CDI (Scale 






For 


User vs. Control Groups, 


by Se>: 






Source of Variation 


Sum of Squares 


Degrees of 
Freedom 


Mean 
Sauare 


y 


Treatment 


0.3 


1 


^ . ^ 


0.5 


Sex 




1 


Sh.h 




Interaction - 


87.2 


1 


Z7.2 




Mean 


U32.C 


1 


US2.-: 


27.8 


Covariates 


1033.0 


1 


1033.0 




Error 


206U.3 


119 


17.3 




* p< .05 
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Table 19 CEWS Item 12 



1 



Means 
S.D. 



Control 
Pre Post 



3.5 
1.0 



61 
3.9 
.9 



Pre 



Group 

ECES-ONLY 
Pre PostECES 



87 8l 
3.5 3.3 
.9 1.0 



19 
k.i 

.89 



Pre Pre 



DMS 

Post ECES 



105 8° 
3.5 3.0 
.9 1-3 



91 
3.0 
.9 



CDNB 



9o 
U.U 
.8 



65 
3.5 
.9 

o3 
3.2 
1.0 



2.9 
1.2 

65 
3.5 
1.1 

o5 
2.9 
1.0 

65 
2.9 
.9 

63 
2.9 
1.0 

65 
3.2 
1.0 



.9 

62 
1.0 

oO 

3.1 

1-1 



1.0 



o2 

3.2 
1.1 

ii2 

3.3 
1.0 

6U 
3.0 
1.0 

o2 

Q 



8C 



80 

5.7 3.5 
1.0 1.0 



BO 78 
5.3 3.1 

1.0 .9 

-86 77 

3.1 2.7 

1.2 1.1 



85 



76 

3.6 5.3 
1.1 1.1 



Bo 79 
3.0 2.9 

1.0 1.0 

85 80 

3.1 3.0 
.9 1.0 

86 78 
3.1 3.0 

.9 1.0 

85 80 
3.^ 3.1 
1.0 1.0 



50 

3.9 

1.0 

73 
3.9 



78 
3.U 
1.1 



1.1 



79 



3.5 
1.0 



3.6 
1.0 

78 

3.U 
1.1 

78 
3.7 
1.0 



106 89 
3.5 2.9 
1. 1.3 

106 87 
3.1 2.9 
1.1 1.2 

105 86 

3.1 2.6 

1.2 1.3 

106 39 
3.^ 2.9 
1.2 1.1 

100 38 
2.9 2.U 
1.0 1.0 



105 
2.9 
1.0 



39 
2.6 
1.0 



105 88 
2.9 2.6 
.9 1.1 



106 



8h 

3.3 2.7 
.9 1.2 



8a 
3.7 
.9 



90 

3. 
1. 

37 
3. 
1, 



88 
3.6 
1.0 

39 
3.0 
.9 

39 
1.0 

90 
3.3 
1.0 

87 
3.6 
1.1 



97 

U.3 
.8 

97 
U.2 

.9 

u.o 

1.2 

97 
U.2 

.9 



97 
3. 
1. 

96 
U. 



95 
U.O 

.9 

93 
k.2 

.9 
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Table ?C 

Mean Counselors' Ratinrs of Students' Preparedness on Items of the CDMS Test 



Item 1 



Before us in.": EC3S 
^.5 



c 
t 

p. 
9 

10 

11 
\? 



Aftei using SCSS 

3.? 

■■•.2 
3.6 
U.l 
3.5 
3.5 
^..6 

B.'J 
3.^ 
3.5 
3.5 



Gain 

1.2 

1.? 

1.8 

1/) 

1.5 

T • 
«k. • * 

1.2 

J. • 

2.0 
1. Y 
l.H 

1.? 



Table ?1 

Students' Report of Time Spent Talking to Parents 

Control EC ES -ONLY DMS 

Pre Post Pre Post-Pre Post-Post Pr; Post-Pro Post-Post 



N t>!i Txl 87 yP 79 10'> 101 100 



Mean ?.0 r-.O P.o 2.^ 



Standard 1.0 1.0 i.O l.i L.'l 1.1 .9 1.2 

'eviati on 



Table 22 

Students' Ratings of Importance of Planning on Item lU of the CDM3 Test 

Control EC ES -ONLY DMS 

Pre Post Pre Post-P^-e Post -Post Pre Post-P-e Post-Post 

N 61 8? 79 60 105 101 



Mean 



Standard .'^ .9 .9 .8 .3 

Deviation 



Table 2"^ 

Students' Reports of Makin,^ Better Use of Talks with Counselors and Parents 
After l^ing SClilS 

EC ES -ONLY DMS 

N 81 103 

Mean ^.6 3.^* 

Standard Dev'iation 1.5 



Tabl( ?h 

Nu.'^^bor of Students in Pretest and Posttest Hanks on the CDMo T'^st 





QMS 




T?/*' T^C / \T>TT V 




Control 


Protest Rank 
I 




18 




I 

it 












6 




11 






p 






0 




o 








Posttest Rank 
1 








1 






1 


P 








20 






O 


-) 




0 












Improvement 




21 




16 








Improvement 




oc 




70 






-0 






Table 












GDI (Scale A). Pretest, Posttest 
:'or TV^ree Intensive Study Groups, 


and Ad.iusted Means 
by Sex. 


anc: Standard Deviations 


Treatment 
Group 


Sex 


Number 


Pretest 

Standard 
Mean Deviation 


Postt 
Mean 


est 

Standard 
Deviation 


Adjusted 
Mean 




Males 




95.2 


20.9 




^1J 


J 1^.5 




Females 


?o 


101.7 


18 J. 


121.'-^ 




;i'^'- 


FICSS-ORLY 


Males 




■;8.8 




10 s:^ 




"01. i; 




Females 


38 


97.^' 


18.6 


lO<^^3 




108 ^> 


Control 


Ma.1 s 








101 . 




10'..''' 




Keinal - ^r, 


V), 


>h. 




101.'^ 







TC?AI. l'.-'^ ^1.'^ 108.> 



ERIC 



Table 26 

Two-V/ay Analyf^is cf Covariance of CDI (Scale A) Pretest and Posttest Scores 
for Three Intensive Study Groups, by Sex. 



Source of 
Variation 


Sum of 
Souares 


Degrees of 
Freedom 


Mean 
Square 


F 


Treatment 




2 




6.0* 


Sex 




1 




C.7 


Interact] on 




? 


i»B9.9 


1.^ 


Mean 


113^7. 6 


1 


113?7.6 


30,8* 


Covariates 






/'ill 189. Q 


IPO.P* 


Error 


66570.3 


l3l 







Tab.le ?1 



CDI (Scale 3) Pretest, Posttest, and Adjusted Mean? and otanuard Deviations 
for Three Intensive Study Groups, by Sex. 



Treatment 
Group 

dm:- 



Contro] 



Sex Number 



Pretest 



Posttest 



Standard Standard 
Mean Deviation Yican Deviate on 



F-?malen '^8 



Mai- s , 
Females 3' 



P3C.? he. 3 
23U.I u7.C 



•'7^.8 



.0 



P51.B W.l 



^•30.8 ^i3/' 



^d^usten 
Mean 



ERLC 



TOTAL 



188 



Table 28 



Two-Way Analysis of Covariance of CDI (Scale B) Pretest and Fosttest 3oo»^es 
for Three Intensive Stuc-y Groups, by Sex. 



Source of 
Variation 



Sum of 
Squares 



Degrees of 
Freedom 



Mean 
Square 



Treatment 
Sex 

Interaction 
Mean 

Covariates 
Srror 



39991.'? 
6115.8 

715.5 

77168.6 
153097.8 
3iU-7;:.3 



2 
1 
2 
1 
1 

IBI 



6115.8 
356.0 
77168.6 



ll.u** 
^.5* 
0.? 



* p < .05 
** p <.oi 



Table 29 



CDI (Scale C) Pretest, Posttest, and Adjusted Means and Standard Deviations 
for Three Intensive Study Groups, by Sex. 



Pretest Posttest 

Treatment Standard Standard Ad,1u'--tea 

Group Sex Number Mean Deviation Mesm Deviation Mean 

DMS Males 29 1722 5.2 I8.6 6.0 I8.6 

Females iO I8.I 3.7 19.6 1-..5 19.2 

ECES-OflLY Males 31 17.5 '-.B 17.0 6.0 K'^.'I 

Females 3O 17.9 '^^.2 17.7 5-7 il.h 

Control Males 26 la. 2 7.-'' I6.8 6.2 iQ.h 

Females 3U 18. 0 3.9 17.3 5.2 17.0 



TOTAL 



188 17.3 



5.0 



17.8 5.6 



Table 30 

Two-VJay Analysis of Covari^nce of GDI (Scale c) Pretest and Posttest Scores 
for Three Intensive Study Groups, by Sex 



Source of 
Variation 


Sum of 
Squares 


Degrees of 
Freedom 


Mean 
Square 


F 


Treatment 


lOU.G 




52.0 


2.0 


Sex 


0.5 


1 


0.5 


0.0 


Interaction 


38.1 




19.1 


0.7 


Mean 


1163.8 


1 


1163.8 


45.3 


Ccvariates 


1132.'' 


1 


1132.'^ 


l;L.l 


Error 




l8i 


25.7 





Table 31 



Last Year's Certainty of Vocational Choice Repcrted Retrospectively by 
the Three Intensive Study Groups 



Response 



Treatment 
Group 


Very 
Uncertain 


Somewhat 
Uncertain 


Somewhat 
Certain 


Very- 
Certain 


Total 


DI«4S 


17 
(30^) 


20 

(35^) 


l!^ 
(25^) 


6 

(10^) 




SCSS-ONLY 


Ik 


19 
(30-X) 


22 

(3H) 


9 


Gl 
(IOC'',) 


Control 


Ik 


20 


17 

{2%) 


(13^.) 


59 
(lOO^o) 



X2 = 2.1(5, n.s. 



Table 32 

Current Certainty of Vocational Choice Among the Three Intensive Study Groups 



Response 



Treatment 
Group 


Very 
Uncertain 


Somewhat 
Uncertain 


Somewhat 
Certain 


Very 
Certain 


Total 


DMS 


(9I) 


6 

(llf.) 


21 

(38^) 


23 
(U2-^) 


55 
(100^) 


ECES-ONLY 


8 

(12-X) 


11 

{in) 


32 

{^m 


15 

(23^) 


66 
(ioo/„) 


Control 




18 

(3H) 


28 

(U8^) 


(12^) 


58 
(100^) 



= 17.8, p. < .01 



Table 33 



Mean Ninth -Grade and Tenth-Grade Grade -Point Average for Three Intensive 
Study Groups . 



Treatment 
Group 



Number 



Ninth-Grade 
Mean GPA 



Tenth-Grade 
Mean GPA 



DMS 



U2 



2.7 



2.7 



SCES-ONLY 



66 



2.8 



2.8 



Control 



5U 



2.U 



2.U 



Table 3U 



Number of Absences from School During Semester for Three Intensive 
Stur]y Groups . 



Treatment Absentee Rate 

^'^^'^y Low (0-5 days) High (6 or more days) Total 



pre 


?7 


PI 












SCES-OSLY 


hi 


?5 


69 






(36^) 


(100^,) 


Control 


:..6 

(?-%) 


3° 


55 






(100^) 



15.6, p < .001 



Educational and Career Exploration System 



Student Questionnaire 



During this school year, you have engaged in a number of activities 
which may have helped you think about your educational and vocational 
future. 

This questionnaire is designed to find out what you have done and 
how much help you have received in your career planning. 



Name : 



School : 



Sex: Male Female 



ECES/DMS/72 



lAoLS 35 (Continued) 



DMS 



1. Please indicate below how many^ timeg during this school year you engaged in 





1-3 


h.6 


7-0 


10+ 






29 


13 


_ 1 




hi 


1I4 


p 








?h 


>\ 





Career Exploration System (ECES). 



ECFS 0\TY 



Not Relevant 



Individual conferences with your counselor about your n.r. 


0 


1-3 


l»-5 


educational and vocational plans. 


3 


9 


35 


11 




3 


22 


29 


h. 

- 



Group sessions about Decision Making and career planning 



2, How would you describe yourself now with relation to your career plans 
for the future? 

D?^ ECES ONLY 



pa. 


1. 


I 


haven't thought much about my future plans. 


3< 


3 


2. 


I 


am 


really uncertain about my future plans. 


12 




3. 


I 


am 


somewhat uncertain about my future plans. 


3^* 




4. 


I 


am 


rather definite about my future plans. 


UO 


15 


5. 


I 


am 


very definite about my future plans. v 


10 



3. How were you last year at this time (i.e., at the end of 9th grade) in 









1 


3? 






3 


11 


it 


'3 


5 



I hadn't thought much about my future plans. 
1 was really uncertain about my future plans • 
I was somewhat uncertain about my future plans. 
I was rather defini te about my future plans, 
I was ver y definite about my future plans. 



ECES ONLY 

ho 
17 
3 



Hotet The entries pnder Questions; ? and 3 are the per cents of the respondent groans 
che^^king the oarticular response. 



N.R. means No Response. 



TABLi 35 (continued) 



Please indicate below the extent to which you have been helped during the 
past year in various aspects of your career planning. Rate each of the 
sources of help using the following scale: 



Sources of Help 

(ECES) ECES Terminal Visits 

(CO) Individual conference with counselor 

(DMS) Group sessions on Decision Making 



Amount of Help 

1. None at all. 

2. Hardly any help. 

3. Some, but not much help. 

4. A considerable amount 
of help. 

5. A great deal ot help. 



To what extent has each of the sources: 



4. been holpful to you in the area of educational 
planning? 

5. been helpful to you in the area of occupational 
planning? 

6. helped you find definite paths of action in 
reaching your goals? 

7. helped you understand how your strengths and 
weaknesses fit in with jour educational goals? 

8. helped you understand how your strengths and 
weaknesses fit in with your occupational goals? 

9. helped you find new information about the world 
of work that helped you make decisions? 



ECES 



70 



U8 



79 



10. made you feel more aware of the p.^ssible educational 

alternatives you have? 70 



11. made you feel more aware of the possible o ccupational 
alternatives you have? 

12. helped you become aware of the important factors on 
which to base your educational decisions? 

13. helped you become aware of the important factors on 
which to base your occupational decisions? 

14. tielped you make better educational decisions? 

15. l>clped you make better occupational decisions? 



72 

iL 

75 
60 

70 



DMr> 

CO 



J2_ 



6^ hh 



55 
52 
5? 
52 

5U 



DMS 



71'^. 5(yi^ 3¥o 



30 

26 

_27_ 

JL 
36 

25 

23 

32 

30 
36 



hcp:s only 



ECES 



32^ 

kk 

20 

ho 

U6 

J40_ 

56 
33 

28 

no 



\ote: Fr.tries above are ner cents , based on number rating U or 5 divided total 
vhc responded to these questions. 



TABL3 35 (Continued) 



16. About how many new occupations did you explore this year that you previous 
knew little or nothing about? 

SCES ONLY 

1. None 

2. 1-3 





"T. 

4. 7-9 

5. 10 or more 



17, Aoout how many new majors did you explore this year that you previously 
knew little or nothing about? 



1. 


None 


2. 


1 - 3 


3. 


4 - 6 


4. 


7 - ? 


5. 


10 or more 



18, Do you feel that because of using ECES you can profit more from talks with 
your counselor? 

1, Definitely not 

2, Probably not 

I 3^ Probably would ^ 
i 4, Definitely wouldl 



19, About how many times did you talk with your counselor about your ECES 
printouts (charts)? 



39?^ 



1, Not at all 

2, Once 

3, Tt^ce 



4. 


3 


times 


5. 


4 


or more times 



20, How often did you discuss the ECES system with your parents? 



1, Never 

2, Once 

3, Twice 



—trr 


-T 


times 


5. 


4 


or more times 



21. What was your parents* reaction to the ECES prirjtouts (charts)? 



C 



1. They didn't see any printouts 

2. Definitely unfavorable 

3. Generally unfavorabl e 
Generally favorable 



"ZT^i Generally favorable [ 
5. Definitely favorable [ 



100 

T/vBLS 35 (Continued) 



22. What is your overall reaction to the Educational and Career Exploration 
System as a vhole , including the terminal visits, the proup sessions, the 



assignments , and the counselor conferences? 

DMS ECES OI'jLY 
1. Of little value in my career planning Ti^^ 

c3 2. Of some value in my career planning 

'3? 3. Of considerable value in my career planning ^3 

3I1 4. Of great value in my career planning ig 



Educational and Caveer Exploration System 
Questionnaire for Parents 

During the past year at school your 10th grade student has had the 
chance to use the Educational and Career Exploration System (ECES). To 
help us evaluate the worth of ECES we are asking both you and your student 
to fill out the enclosed questionnaire and mail it back to us. Yo;'r ansuers 
are confidential and no one at your student's school will see them. Please 
be as frank as you can; we value your answers since we want to mLKe ECES 
useful to both students and parents. 

Our student is: male female . 

Qtjr student's school Is _ 

Our student's name is ^ . 

Please fill this out and mail it as soon as you can, along with the 
one which your son or daughter filled out. Please use the enclosed envelope 

addressed to: 

ECES Evaluation Study 
Box 164 

Teachers College 
CoUunbia University 
New York, N.Y. 10027 



ECES/DKS/72 



TABLE 36 (Continued) 



DM3 



!• To what extent has your son or daughter discussed with you his or her use 
of ECES in exploring educational and career possibilities? 

1, 



Not at all. 



2. It was mentioned — but only briefly. 
Am There has been so me discussion-'but not much. 



There tias been quite a lot or discussion 
different times. 
5. Is^e discuss it regularly. 



?2 



2. Following are some of the activities which the ECES program involves. 
How much has your son or daughter talked about these with you? 

FCES OrJLY 



:\ 4 UCC ♦ 


P'rea . 


Terminal visits on ECES 


Not at all Occasionally 

Uo U5 


Frequently 
16 


U6 


'jl 2. 


Print-outs from ECES computer 


h3 hi 




1^ 




20 3. 


Individual conferences 
coansG lots 


with 






10 


53 


'=3 4. 


Reading about occupations 






1? 


* 1 


'3 5. 


Reading about schools 
to after high school 


to go 


57 29 




lU 




" 6. 


Assignments as part of the 
Decision Making Sessions 


Mot Relevant 






U7 


■■ 7. 


The group sessions on 
Decision Making 




Not Relevant 








3. Do 
or 


you feel that you have become more involved in your child's educational 
vocational planning since his or her participation in the ECES program? 






1. Definitely have not. 

2. Probably have not. ECVA^ 


ONLY 






6y'. 


. 1 

1 


J. Frobabiy have. 
4. Definitely have. 


U3< 




3. 





ERJC 



TABLi* 36 (Continued) 

4. Read statements A through G below, then select 1 of the 5 possible answers 
that best indicates how inuch help you feel your son or daughter has received 
from the ECES program in each of the areas below: 

1. None at all. Per '^er.t Check inp ^ Or 

2. Hardly any help. 

3. Some — but not much help. 

4. A considerable amount of help. 

5. A great deal of help. 



A. Seeing connections between his or her high school 

experience and future plans 
3. Getting useful facts about the world of work 

C. Seeing connections beD^een his or her interests 
and possible occupations 

D. Seeing connections between his or her abilities 
and possible occupations 

E. Discovering new occupational possibilities he 
or she might look into 

F. Discovering new educational possibilities he 
or she might look into 

G. Making good decisions about what to do after 
high school 





DMS 


KCES O'^LY 


A. 






B. 


53 


33 


C. 


7U 




D. 


6'i 


uo 


E. 




3? 


F. 




?3 


G. 


5? 


27 



5. Do you feel your son or daughter is better able to make decisions about 
hLs or her career as a result of participating in the ECES program? 

DM? ECES 0:iLY 



1. Definitely is not. 
?- Prob ably in nof 



3. Probably is. 
4 nf^f-fnitPly 



5. 



6. Read statements A through F below, then select 1 of the 5 possible answers 
that best indicates how active you have been in each of the areas below: 

1. Not active at all. 

2. Sot very active. 

3. Fairly active. «nt Che-Hn- 3, h or 5 

4. Very active. 

5. Extremely active. 



DMS ECES o::ly 



ERIC 



A. Helping your son or daughter find summer 
employment that related to career goals 

B. Meeting with a school guidance counselor to 
discuss your son*s or daughter's situation and 
plans 

C. Making sure that your son or daughter was meeting 
with the counselor 

D. Encouraging your son or daughter to talk with in- 
dividuals employed in careers he or she is 
considering 

E. Obtaining books, pamphlets, or other educational 
and occupational information to assist your son 
or daughter to decide on future plans 

F. Obtaining privrate vocational testing and counseling 
for your son or daughter 



A. 


2H 


291. 


B. 


IP 


10 


C. 


% 


V- 


D. 


53 


49 


E. 


Ui 




F. 




2 



TABLS 3'^ (Continued) 



7, How far do you plan for your child to go in school? 



Less than high school diploma or equivalent 
High school diploma or equivalent 



^Poot - high sch o ol iiaiuiiig viher than Jr, coll^g^ ' 
jjr> college graduation 



■ Coll e ge giadu^Lluu 
iCraduate school 



DMS 



-3^ 



-her 



KCKS QMLY 
Ul 



8. How far did you go in school? 



.Less than high school diploma or equivalent 
[High school diploma qj- ^gti^vnlpnf 



i PubL-liigh i?cho qt rrainittg bther tnan jr, coxiege 
|Jr> colleee graduate 



jCollege g r adua r e 
{Qraduiate school 



DMS 



ECES ONLY 



Father Mother Fa. Mo. 

m9 '7? 



1.^ 



lb 

1?; 



9. What are your occupations? 

Current or 
Usual Job Title 

(e.g., engineer. Type of Employer 

carpenter, filling (e.g., factory. Currently 

station attendant) bank, garage) Unemployed 

Father 

(Male Guardian) 

Mother 

(Female Guardian) 
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CAREER DECISION MAKING SKILLS TEST 
GENESEE INTERMEDIATE SCHOOL DISTRICT 
Office of Vocational Education 
2413 West Maple Avenue 
Flint, Michigan 48507 



NAME 

SCHOOL 

Sex: M F (Circle One) Age Grade. 

Your Counselor's Name 

Have you used ECES? No Yes (Circle One) 
If yes, how many hours ?^ 

How would you describe your plans for after high school? 

Circle One 
Number 



1 I am undecided at this time. 

2 I am going to get a job right after high school. 

3 I am going to get about one year of training and then get a job. 

4 I am going to a two-year vocational -technical school and then 
get a job. 

5 I am going to a two-year junior college and then get a job. 

6 I am going to a two-year junior college and then transfer 
to a four-year college. 

7 I am going to a, four-year college. 



Item # 1. What occupation, or job, do you think you will tal'e to earn your living 
after you finish your schooling? Pick the job that seems most likely 
to you at this time. Write the name of that job below. 



Item if 2. Write down as many of the important things as you can that you would be 
expected to do on that job. (Be specific.) 



1. 
2. 
3. 
4. 
5. 
6. 
7. 
«. 
9. 
10. 



Item a 3. One reason people select an occupation is because they want to share common 
interests with other people in these occupations. Of the interests listed 
below, which one do you feel is the most important interest shared by the 
people in the occupation you chose in Item #1. 



Circle One 
Number 



1. Service: providing service to people. 

2. Business Contact: working with people in a business situation. 

3. Business Organization: planning and leading a business situation. 
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4. Technology: working with equipment and machines to solve problems, 

5. Outdoor: working outdoors. 

6. Science: working with ideas and information to explore and solve 

problems. 

7. General Culture: working to understand and relate the knowledge 

about people. 

8. Arts, Entertainment and Recreation: working to provide recreation 

for people. 

Item # 4. How much education or training will you need to prepare yourself to enter 
the job you chose in Item #1? 

Circle One 
Number 

1 High School Diploma. 

2 Apprenticeship or Technical Training up to 6 months, 

3 Apprenticeship or Technical Training up to 1 year. 

4 1-2 years Technical or Vocational School. 

5 2 years Junior College or Vocational School, 

6 4 years College. 

7 More than 4 years of College. 

Item # 5. Write the specific major areas of study, or major areas of training 
that you could take to prepare for the job you chose in Item #1. 

1. 

2. 

3. 

4. 

5. 

ERiC 
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< Item # 6. Write the specific high school courses that you must take to prepare you 
to enter the level of schooling or training you selected in Item #4. 



1. 
2. 
3. 
4. 
5. 
6. 
7. 
8. 
9. 
10. 



Item # 7. Write down the names of any other occupations or jobs at which you are 
thinking about ecrning your living after you finish school. 
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Item # 8. When you ask for information about jobs, you ask for very specific kinds of 
information. Then you use this information to decide whether or not you 
like the job. One kind of information you might ask for is how much money 
the job pays. Write down as many other kinds of specific information yo u 
feel are important to know before deciding about a .iob . 

1. 

2. 

3. 

4. 

5. 

6. 

7. 

8. 

9. 
10. 
11. 
12. 
13. 
14. 
15. 

Item # 9. This item ha<^ two parts. When you have a question about your future school 
or occupation J i plans, you look for infonnation to help you answer the 
question or solve any problems you might have. 

First, list the different sources of inforniation you would use. 

Second , describe the general kinds of information you would want to 
know from each source. 

Things you would want to know 
Source of Information from each source 
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2. 2. 

3. 3. 

4. 4. 

5. 5. 

6. 6. 

7. 7. 

8. 8. 

9. 9. 

10. 10. 

Item #10. This item has six. steps. Look at the four occupations listed below. They 
can be arranged in many different ways to show you they are different from 
each other. 

Doctor 

Electrical Engineer 
Beautician 

Heavy Machine Operator 
Step 1 Arrange these occupations into two groups: 

GROUP I GROUP II 

A. A. 



B. B. 



Step 2 Tell why you grouped them as you did. 
GROUP I. 



GROUP II 
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Step 3 In GROUP I, tell how A is different from B. 
A. 



B. 



Step 4 In GROUP II, tell how A is different from B. 
A. 



B. 



Step 5 Add one occupation to each gy^ouD that is similar to the occupation in 
that group. 

For GROUP lA, add 

For GROUP IB, add 

For GROUP IIA, add 

For GROUP I IB, add 

Item #11. Suppose that you were tryinq to decide whether you waned to be a 
reporter or a salesperson. 

Suppose that you could only ut*? the followiJ^a information to make your 
decision: 

A reporter earns $8,000 oer year, must have at least 2 years of college 
education, and must work under the close direction cf his editor. 

A salesman (or saleswoman) can earn i>c to $r^,000 per year, needs only 
six months of special trainina beyond high schoo'' , and is o^on free to 
determine his own daily working patterns. 



Name the occupation vou woul'i c^^^^c'* 
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In the space below, show the steps you took in ir-akina your choice. 



Use numbers to indicate how much more favorable the occuoation you chose 
was over the one you didn't choose. 



Item #12. The purpose of this item is for you to indicate how well preoare^d vou 
feel you are to make your career nlanninq decision^ - — 

To make a good career olanninq decision, you shcuV: 

1. Know all the important FACTS of information about thp decision. 

2. Understand what your PERSONAL requirements are fo-^ all the different 
parts of yoor decision. 

3. Understand how well your p'^rsonal rr-qui^oment^^. PlLATF to the facts 
about all aspects of the decision. 

Use the following scale to indicate hoy;_v/olJ_pre£aj;;e(d vou ^et^l vou are in 
each area listed below. * 

5 I feel very wel l prepared to make this decision. 

4 I feel well prepared to irake this decision. 



3 I feel fairly w el 1 prei^arod to m^ro t^^- ^ •:!(?c"!S'''r«. 

2 I feel poorly prepared to mdkp this dt'C.isif)n. 

1 I feel very po orly oreoarod this rjecis^on. 



AREA Y'^ijR RA"^jNn 

( C i re ' C-* Vou") ~RaT ; r.o 
^cr r^ch Area) 

1. Making a decision about what high <^c'^\':o1 i »^oqrc*«(r 

I should* take. , ' ' ' ? \ 
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2. Making a decision about which hiqh school courses 
will best prepare me for the occuDations I am 

considering. 5 4 3 2 1 

3. Making a decision about what kind of Dost high 
school education or training will best prepare me 

for the occupations I am considering. f 4 3 2 1 

4. Making a decision about which schools I should go 
to after high school to prepa-^^e ne for the types 

of training or education I need. 5 4 3 2 1 

5. Making a decision about what occupations o^^ Jobs 

I am. planning to earn ^7 living at afte?* 1 finish 

my schooling*. 5 4 3 2 1 

6. Making a decision about how to fit all my career 
plans together into a well orfianizrd plan for my 

future. ' 4 3 2 1 

7. Making a decision about what different sourcps of 
information I should use to get the ^nfcrinotion 

I need for my career planning, 5 4 3 2 1 

8. Making a decision about what soecific Kinos of 
information these sources of infovT^aticn hav^^ to 

offer me to help me with v,\y caree-r olanMina. ^ 4 3 2 1 

9. Making a decision about how well a new occuoation 

is suited to my personal requiremertr; . 4 3 2 1 

10. Making a decision about how to identic what 

occupational alternatives are available to n;o. s ^ 2 ? l 

11. Making a decision about what facts are important^ 
to me in choosing among r.y orc*J!:'arioral 

alternatives. ^ 5 4 3 

12. Making a decision about what fdct.% '^r^ ifroortart tr. 
me when choosing among rry educa.':io.jal alternative^. 5 4 3 

13. Making a decision about how to coirbine rry v*c-asn!Kc 
and my values to make a logicai caretr ;'e(Jv :•>;;. 5 4 3 

14. Making a decision about how tc combine »nv re-^.scos 
and my values to make a looical pe»^~^c^al occ'sicn. ^ ^ 3 
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Item iil3. During a typical week, about how much time do you snend talking witn 
your parents about your career plans? 

Circle One 
Number 

1 No time at all . 

2 Less than 1 hour. 

3 About 1 or 2 hours. 

4 About 3 or 4 hours. 

5 More than 4 hours. 

Item #14. At this point in your life, how important is U to. you tq be planning 

and preparing for your future career? 

Circle One 
Number 

5 Very Important 

4 Important 

3 Fairly Important 

2 Not Too Important 

1 Unimportant 
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COUNSELOR REACTION QUESTIONNAIRE 



NAME: GROUP: DlvlS 



ECSScnly 

PLEASE RESPOND TO THE FOLLOWING STATEMENTS BY CIRCLING THE 
LETTERS THAT BEST DESCRIBE YOUR REACTION: 

SA A D SD X 

Strongly agree agree disagree strongly disagree does not apply 

Note: Tiie abbreviation ECES/DMS refers either to ECES alone or to 

the combination of terminal and group sessions, depending upon 
v/hich experience your students had. 



Extent of arreeraent 



!• Students know a lot more about themselves SA 
after using ECSS/DMS. 

2. Students have more occupational and educ- 
ational information after using ECES/DMS. 

3- ECES/DMS gives the students a frame of 
reference that helps them think about 
their futures 

U. ECES/DMS generates interest in thinking 
about occupations. 

5* Students* etnxieties about occupational 
choice are greatly reduced by ECBS/dMS 

6. Some of the ECES charts tend to dis- 
courage students unduly 

7. ECES/dMS leads students to premature 
closure on their vocational plans 

8. ECES/DMS is appropriate for the special 
needs of the students at our school. 

9. ECES/DMS should be available to: 

9th graders 
10th graders 
11th graders 
12th graders 

10. The followir^g components of the system 
were very valuable for the students: 

1. V.P»I*(Vccar,ional Planning 'Inventory) 

2. O.V.I.S.(Ohio Voc. Interest Survey) 

3. ECES Search Strategies 
H. ECES Charts 

5. Individual counseling sessions 

6. D!4S Group session 

7. DMS student assignments 

11. The extra work created by ECES/DMS is 
justified by the effects on students 

12. The existence of ECES/dMS has lf*d me to 
do some research on the users. 

13" My work with students is at a much 
higher level because of ECES/dMS 
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lU. The presence of ECES/dMS has cause me to 
do some reading I would not have otherwise 
done . 

15- Because of ECES/DMS I have had to neglect 
some students I used to serve better . 

16. BCES/DMS has caused me to see types of 
students I did not previously see. 

17- I have been well provided with informa- 
tion I needed to have in order to help 
W students with ECES- 

18. I feel that I have been an important 

participant in the ECES/DMS field trial. 
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